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The Relationship of High School Teachers' Class Testing Practices 
to Students' Feelings of Efficacy and Efforts to Study 

by 

Kenneth Duckworth, Glen Fielding, and Joan Shaughnessy 
!• Overvlev of the Study 

Purpose 

This paper develops and tests a model of the linkage between high 
school students' feelings of efficacy and efforts to study and high school 
teachers' class testing practices. Data used to test the model Include 
responses by teachers and students to questionnaires administered In four 
high schools In four types of classes: biology, geometry, English, and U.S. 
history. Data were collected In late November, 198A. The primary analytic 
methods are coizq>arlson and correlation. 

With the recent wave of criticism oi lagh schools and the growing 
demand that schools should expect higher levels of academic achievement from 
students, the Identification of points of leverage on students' efforts to 
study Is an Important task for researchers. We attach special Importance to 
students' feelings of efficacy, a concept that means for us the belief that 
effort pays off. If students regard class tests, which contribute 
significantly to students' cumulative record of academic success or failure, 
as unpredictable hurdles where the luck of the draw matters as much as 
students' preparation^ then It may be difficult to Increase their efforts to 
s tudy . 

These considerations Indicate the relevance to secondary schools of a 
model of academic effort rooted In an expectancy theory of work performance: 
level of work effort Is hypothesized to be a function of valuation of rewards 
from work and belief that effort will leaid 1:0 rewards (Lawler 1976). 
Natrlello (1982, 1983) has applied such a theory to secondary school student 
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evaluation processes and their effect on student disengagement. Natrlello 
found that student-perceived '*lncompatlbllltes" In the evaluation system, 
Including unpredictable evaluations, were associated with student reports of 
disengagement, Including withdrawal from efforts to succeed. These 
fundamental assumptions are tested In Section II of this report, which 
examines correlations of high school students^ efforts to study 
with their motivation to do well In a class and their feeling of 
efficacy — ^bellef that s:udylng will enable them to do well on class tests. 
Parallel analyses at both Individual and class levels are conducted for 
biology, geometry, English, and UoS. history classes. The analyses used to 
test the model take Into account differences In students^ academic ability. 

Section III focuses on the relationship of students' feelings of 
efficacy to their perceptions of class testing, particularly the 
predictability of test coverage. In addition to exploring relationships 
among students' perceptions and feelings. Section III relates students 
perceptions and feelings to specific teaching practices. Hence we attempt to 
trace student perceptions of teaching practices to actual practices by 
comparing class means on these variables to variation In teaching practice as 
reported by teachers on a questionnaire. The variables in teaching practice 
studied are derived from general principles of mastery learning as elaborated 
by Fielding in a rationale for Integrating teaching and testing (Fielding and 
Schalock 1985)« 

Among the teaching practices found to be effective in elementary 
school classrooms are teachers' integration of teaching and testing. Fisher 
and his colleagues (1980) found that students' academic learning time was 
positively related to working on tasks that were adapted to their learning 
level and that focused on knowledge and skills that were to be tested. This 
finding has encouraged advocates of mastery learning programs to develop 
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programs for training teachers, including high school teachers (Fltzpatrlck 
and Charters 1986), to rethink the "forced march" approach to curriculum 
coverage and to make assessment of student achievement an integral part of 
Instruction rather than a detached mode of compliance with school grading 
requirements. Fielding and Schalock (1985) have Identified key teacher 
practices In class testing. Including formulation and communication of 
expectations, purposive test construction, and follow -through on te.'^t results 
by adapting teaching for students whose performance Indicates Inadequate 
learning. The present study extends the Investigation of class testing 
practices and tests three hypotheses about then effects on students^ 
feelings of efficacy- 

The descriptive-correlational analyses of class testing practices 
reported In this paper were stimulated by an experimental study of a staff 
development intervention to Improve those practices (Fielding, Shaughnessy, 
and Duckworth 1986)* The research reported In this paper was conducted 
simultaneoucly with that experimental study, which prompted us to study the 
school context of high school teachers^ class testing practices — especially 
school and departmental policies and collegial faculty relationships that 
might strengthen such practices* Studies of effective schools have 
emphasized the Importance of instructional leadership and a collegial climate 
(Purkey and Smith 1985). Also, a study of elementary school teachers^ use of 
some of the assessment practices advocated by mastery learning found that 
those practices were strengthened by supportive collegial interaction among 
te&chera (Intili 1977)« In Section IV, we report evidence from the present 
study about the relationship of testing practices to policy and colleglallty. 
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Research Procedures 

The design of the research was to compare and correlate teacher 
practices and student perceptions In high school classes* We suspected that 
differences In subject matter structure would affect testing practices and 
their effects on students, so to ensure that the model we were developing 
would be generallzable, we decided to develop It slotultaneously In four 
different subjects* Twenty classes per subject was set as the sampling goal* 
In order to obtain a representative sample of classes for each subject, we 
decided to study a cross-section of all the classes In a small number of high 
schools rather than recruit Isolated and possibly excepti.onal teachers from a 
large number of schools* Therefore, we sought five classes each In subject 
In each of four high schools* 

In studylLj teacher and student perceptions In a large number of 
classes, we deemed questionnaires the most efficient source of data* Early 
contacts with administrators In potential research sites Indicated reluctance 
to commit too much school time to questionnaire administration, so It was 
decided to focus on one course In each subject and to administer 
questionnaires to five teachers of that course in each high school* In order 
to gather Information about school and departmental policies on class 
testing, we Interviewed administrators and chairpersons of each participating 
department during the spring of 1984* At that time, we obtained their 
cooperation In selecting teachers and classes to receive the questionnaire In 
November, 1984* Each of those teachers was Instructed to choose one class, 
or "section" of the course, to fill out the student questionnaire* 

Selection of classes in which to administer the questionnaires was 
based on our desire to study a cross-section of the students taking a 
particular subject in each school* Where all classes in a subject were in 
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principle heterogeneous, we asked each teacher of the subject to select one 
class. Specific sampling decisions are described under "Sample 
Characteristics" below. Where sections were tracked, we asked teachers of 
each track to select one class. (We excluded upper-level "advanced 
placement" classes from our study, however.) Although we sought five 
teachers per course. It transpired that In some schools, some courses were 
taught by fewer than five teachers. Furthermore, one English teacher 
withdrew from the study upon receiving the questionnaires. Thus the actual 
sample Included fewer teachers and classes than planned: 16 for biology; 18 
for geometry; 18 for English; and 17 for U.S. history. 

This model development study was linked with a concurrent 
experimental test of a staff development Intervention In science courses 
(Fielding, Shaughnessy, and Duckworth 1986) c Thus In two of the biology 
classes In each school, the questionnaires followed a series of Interviews 
with rf achers about testing practices and concomitant observations of class 
sessions when tests were passed back and discussed. Moreover^ In two of the 
four school^:^ those teachers also expected to participate In a series of 
workshops regarding class testing practices. 

The questionnaires were pilot tested In spring 198A with five science 
teachers In a nonpartlclpatlng district. We eliminated Items with 
Insufficient variation and Items where correlations did not Indicate 
sufficient construct validity. The final questionnaires are included in 
Appendix A. Both teacher and student questionnaires asked respondents to 
answer modJt of the questions in terms of the specific class during which the 
questionnaires were administered. 
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Sample Characteristics 

The four high schools participating In the study were located In two 
districts In the Northwest* Each district had a reputation for academic 
excellence, supported by the fact that Its students^ Scholastic Aptitude Test 
scores were higher than the state average* District A was located In a 
medium-sized city. The city housed one of the state universities, and the 
population ranged from upper-mlddle-class professionals to working-class 
people* Schools 1 and 2, both in District A, were schocls including grades 
9-12 and enrolling 1,000-1,300 students each. District B was a suburban 
district near a large city in the same staite as District A; it served a 
largely middle-class and uppei^-middle-class clientele. Schools 3 and A, both 
in District B, were larger schools of 1,500 or more students each, serving 
grades 10-12. Whereas District. A was on a trimester system. District B was 
on a quarter system. 

Administrative Characteristics. In all four schools, the primary 
responsibility for administering the instructional program fell to an 
assistant principal or vice-principal for curriculum, although the principal 
remained formally responsible and would always be Informed about 
developments. In the organizational structure of all four schools, the 
person below the assistant principal for curriculum was the department chair. 
Department chairs were largely administrative posts rather than academic 
leadership posts, although this varied by school, to be described in Section 
IV. All four schools used the standard letter grading system and mailed 
academic progress reports or warning notices to parents midway in the quarter 
or trimester. School 1 was unique among these schools in having an 
eighth-period day, during which students had two free periods. This allowed 
for more interaction between teachers and students in remedying student 



learning problems than was possible In the other three schools, where 
students were In class each period during the regular school day. 

Currlcular Characteristics. As mentioned above, we needed to Include 
several sections of each subject In each high school. Our plan was to focufi 
on courses taken by a cross-section of students In each school, which 
dictated that we seek courses taken In the sophomore year (District B lacking 
the ninth grade) while currlcular branching was at its lowest level. 
Specific sampling decisions regarding classes to be studied In each subject 
were made within a framework of the school^s currlcular offerings. We 
discuss the sequence of courses In each subject that Informed our sampling 
decisions. 

In science, each of the four schools offered a standard curriculum: 
biology for sophomores and chemistry, physics, and advanced biology for 
juniors and seniors who wanted a fuller college preparation. The biology 
course was the only one of the three subjects to approximate a "required" 
subject, although it was possible for students to satisfy high school 
graduation requirements without taking biology. The schools varied in their 
currlcular differentiation with regard to academically weak students and 
academically strong students. Schools 3 .^nd A had more offerings for 
advanced students, whereas Schools 1 and 2 had more offerings for students 
with low slclll levels. 

In mathematics, as in science, all four schools offered the standard 
sequence of college preparatory courses — algebra In the 9th grade (taken in 
the Junior high schools of District B), geometry in the 10th grade, advanced 
algebra in the 11th grade» and precalculus or calculus in the 12th grade. 
This regular track of courses was the stem for numerous branching, however. 
Some students would never take algebra hut would take courses such as "math 
for life" or "intermediate math" to complete their high school graduation 
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requirements* Other students would be shunted after algebra Into a series of 
"elements of • • or survey courses that covered the standard college 
preparatory curriculum In less depth and with less speed. For example. In 
Schools 3 and 4, students might take "survey of math" In the 10th grade^ 
which Included both geometry and algebra. Still other students, especially 
In District B, might be shunted Into accelerated courses after algebra and 
would complete the equivalent of a college course In calculus In their senior 
year. 

Dxe English departments In the four schools were alike In offering 
one standard course for sophomores* School 3 offered several sections of 
advanced sophomore English; School 4 did not, although the more able student 
could petition to waive sophomore English and proceed directly Into 
literature and composition courses usually reserved for the upper grades* 
School 1 offered both "survey" and "advanced" sophomore English In addition 
to regular sections; School 2 offered only "advanced" and regular sections. 
In all schools, there were remedial courses that students might take Instead 
of sophomore English, but these classes ei^rolled only a few students and were 
not Included In our study* 

The social studies departments varied In the sequencing of courses, 
and there was no single course taken In the 10th grade at all four schools* 
Becau&e U*S* history was a course required of all students, we chose that 
course to study* It was generally taken by Juniors, although School 2 
allowed sophomores to take It. School 3 offered "basic" and "advanced" 
sections In addition to regular U*S* history; Schools B and C offered only 
regular sections; School 2 offered "developmental" sections In addition to 
the regular U*S* history course* We included each type of class offered in 
our sample* 

Figure I-l shows the actual sample of classes studied* Of the 16 



Figure 1-1 

Configuration of the Sample of Classes: Number of regular, high-track, 
and lov-track classes In each subject in each school^ 



School/Track 

High 

1 Regular 
Low 

High 

2 Regular 
Low 



Biology 
3 Regular 



1 "Honors" 

2 Regular 
1 "Skills" 



Geometry 



3 Regular 
7 "Elements" 

1 "Advanced" 
1 Regular 
1 "Elements" 



English 

1 "Advanced" 
1 Regular 
1 "Survey" 

1 "Advanced" 
A Reo'ular 



U,S. History 
4 Regular 



2 Regular 

1 "Developmental" 



Hlgli 

Regular 

Low 

High 
Tie gal ar 

LOW 



A Regular 



5 Regular 



3 Regular 
2 "Survey" 



3 Regular 
2 "Survey" 



2 "Advanced" 

3 Regular 



5 Regular 



1 "Honors" 
3 Regular 
1 "Basic" 



5 Regular 



High 1 
All Regular 14 
Low 1 



1 
10 
7 



4 

13 
1 



1 
14 
2 



Total 



16 



18 



18 



17 
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biology classes, only 2 were designated as other than regular classes. In 
School 2, we included one "study skills biology** class and one "hon6rs 
biology" class along with two regular biology classes. 

On the other hand, only about half the mathematics classes included 
were regular geometry classes. Of the 18 classes included, 7 were 
lower-track classes: 2 classes of "elements of geometry" in School 1; 1 
"elements of geometry" class in School 2; and 2 "survey of math" classes in 
each of Schools 3 and 4. This higher proportion of lowei^track classes is 
attributable to the fact that geometry is the least widely taken of the four 
subjects. In order to include a number of teachers roughly equivalent to the 
numbers included for the other three subjects, we had to extend the sample to 
courses taken by students weak in math (all of which included geometry 
subject matter, although the "survey of math** classes also included algebra). 
The saiiq[>le also Included one "advanced geometry" class for 9th graders in 
School 2. 

With sophonore English, the problem was different. All students took 
this course^ and we included only one lower-track "s;irvey" — section in 
School 1. However^ three ot the four schools offered several sections of 
"advanced" sophomore English, so for representativeness we included four such 
classes — one in each of Schools I and 2 and two in School 3. 

FinalJr. 14 of the 17 U.f. history classes were also "regular" 
classes; we included one "develo^jmental*' section in School 2 and one "basic" 
section in School 3-^ach of which was a small class— and one "honors" 
section in School 3. 

This unevenness in sample constitution, especially in geometry and 
English, Is taken into account in using questionnaire data to develop the 
model. 

Teacher and Student Characteristics. Ideally, we regarded variation 
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In teacher and student characteristics across subjects as undesirable for our 
nodel-bulldlng effort. However, with a small sample, some variation was 
Inevitable. Table I-l shows some Information about the teachers and students 
who participated. There were differences In the length of time teachers had 
been teaching In their current schools. Of the history teachers, none was In 
the first or second year at his or her current school, and nearly half had 
been there more than ten years. Of the English teachers, nearly half were In 
their first or second year, and less than one fourth had been there more than 
ten years. Also, more English and geometry teachers than biology and history 
teachers reported that they h&d more than three preparations each day. On 
the other hand, English teachers reported teaching fewer students overall, 
which Implies that their classes were smaller than, for example, history 
teachers^ classes. This In fact was sonietlmes a matter of policy when the 
English class Involved considerable student writing and therefore more 
teacher time to grade papers. 

The student data shows far more similarity across subjects, except 
for the expected difference In proportion of students In the lOth grade or 
below. The Immediate Impression Is that these courses In these schools 
enrolled educationally successful and ambitious students. From 63 to 75 
percent of the students In each subject planned to go to a four-year college, 
more than half reported that their main courses were college-preparatory 
subjects, and more than half reported that at least one parent had graduated 
from college. Furthermore, when asked about their previous year'^s grade 
point average, from 68 to 81 percent replied that It was In the ''A" or "B" 
range. In general, the geometry students seemed the most academically 
oriented, borne out also by the finding that nearly a third of them indicated 
that they were taking the class in which the questionnaire was administered 
mainly because they wanted to rather than because it was required or 
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Table I-l 

Characteristics of Teachers and Students in Sample 
(Percentages of teachers and students, in each of four subjects and in all» 

selecting questionnaire responses) 



Characteristic 


Response 


Biol 


Geom 


Engl 


Hist 


All 


Teachers: 












Years In school 


More than 10 


38 


41 


22 


45 


37 




1 or 2 




29 


44 


n 


25 


Number of preps each day 


3 or more 


8 


53 


66 


29 


40 


Number of students taught More than 140 


44 


29 


1 1 


53 


39 


Students: 










• 




Year in school 


9th or 10th grade 


88 


62 


97 


14 


65 


Plans after high school 


4-year college 


69 


75 


67 


63 


69 


Main classes 


College-prep 


63 


60 


63 


59 


61 


Grade point average 


A or B 


77 


81 


77 


68 


76 


Parents^ education 


College graduate 


59 


66 


63 


56 


61 




Attended college 


21 


20 


17 


22 


20 




High school only 


20 


14 


19 


22 


19 


Main reason for taking 


I wanted to 


21 


31 


14 


11 


20 


this class 


It was required 


79 


69 


86 


89 


80 



Number of teachers in sample* 16 18 18 17 69 

Number of students in sample* 391 478 420 405 1694 

* Actual numbers for each item depend on numbers of missing responses* 
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recommended^ (All four of the subjects we studied were in fact required or 
recommended for most students at these high schools*) 

II* Developing Model of Influences on Students^ Efforts to Study 
In this section, we present the coizq>onents of a model of influences 
on students^ efforts to study* Using an expectancy* theory of work 
performance (Lawler 1976; Natriello 1982, 1983), we treat such effort as a 
positive function of the value of work rewards to the student and of the 
student^s expectation that effort will obtain n^wards* We begin by using 
data from the student questionnaire to create an index of efforts to*study, 
and we explore the relationship of this index to other measures of students^ 
academic effort and participation in class* Then we investigate influences 
of students^ motivation and students^ feelings of efficacy on their efforts 
. to study* Next, we control on the effects of differential student academic 
aptitude on variables in the model* 

Initially, we develop the model at the Individual level in each 
subject as well as In the four subjects taken together* In exploring effects 
of academic aptitude, however, ve augment individual-level analyses with 
claiss^level analyses and control on differences in track level among classes 
In each subject* Development of the model at the class level establishes the 
foundation for the analyses in Section III, which use data from both student 
and teacher questionnaires to identify the effects of class testing practices 
on students^ feelings of efficacy and efforts to study* 

Students^ Efforts to Study 

The student^s effort to study is the primary criterion variable of 
the model* We focus primarily on the subjective sense of expending effort in 
study and in classwork in general^ although we examine relationships of this 



subjective sense of effort to various other measures of academic effort and 

class participation* 

Our criterion variable was measured by student responses to two 

questionnaire Items, which asked whether the student "nearl> always/' 

"often," "occasionally," or "almost never" studied the material thoroughly 

before tests In the class In which the questionnaire was administered (Item 

31) and worked hard In that class (Item 16). Table II-l shows the 

distribution of student responses to these Items. Approximately one fourth 

of the students reported nearly always studying thoroughly before tests. 

Approximately one third of the students reported that they nearly always 

worked hard In the class. 

The correlation between studying thoroughly and working hard ranged 

from .39 to .52, as Is shown In Table II-2. The two Items were averaged Into 

a single Index of Effort. Means on Effort are shown In Table II-l. 

Because the present analysis of Influences on students^ efforts to 

study Is part of a broader Investigation of students" academic effort and 

participation In school. It was important to us to establish that this 

subjective sense of effort was related to other measures of students'^ 

academic work and participation in class. Hence we coiq>uted the correlations 

of the Effort Index with student responses to each of seven questionnaire 

Items measuring work and participation. One Item asked how many hours the 

student spent each week doing homework or studying for the class. The other 

six asked how often the student: 

had homework done on time 
asked questions In class 
solicited teacher help after class 
"tuned out" during class discussions 
was late to the class 
cut the class. 

Distributions of student responses to these Items are Included In Appendix B, 
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Table II-l 

Students' Effort, Motivation, Efficacy, and Futility 
(Percentage of students. In each of four subjecrs 
and In all, selecting questionnaire responses) 



Qucctlonnalre Item 


Response 


Biol 




Engl 


Hist 


All 


jl« Derore eacn test m 


Nearly always 


23 


1 o 
IB 


•an 


* OQ 

Zo 


24 


cms cxass, i scuay tne 


ut ten 


J3 


32 


1 Q 
JJ 


J 5 


Q/. 


material thoroughly 


Occasionally 


31 


32 


28 


28 


30 




Almost never 


11 


17 


10 


10 


12 


16« I work hard In this 


Nearly always 




41 


38 


29 


J5 


class 


Often 


38 


37 


38 


38 


38 




Occasionally 


30 


19 


21 


27 


24 




Almost never 


t 

H 


2 


4 


6 


4 


10. To mc, doing well 


Very Important 


c c 

55 


67 


63 


55 


60 


In this class Is Somewhat important 


43 


31 


33 


42 


37 




Not Important 


2 


2 


4 


3 


3 


8. The lowest grade I would 


A 


14 


10 


16 


IC 


12 


be satisfied with In this 


B 


40 


46 


45 


35 


42 


course * 


C 


36 


42 


34 


44 


39 




D 


9 


3 


6 


11 


7 


32. If I study hard for 


Nearly always 


42 


41 


47 


44 


43 


this class, the effort 


Often 


31 


29 


29 


26 


29 


Is rewarded 


Occasionally 


20 


22 


18 


20 


20 




Almost never 


7 


8 


7 


9 


8 


35. I can predict how 


Nearly always 


30 


25 


31 


31 


O A 

29 


well I will do a test 


Often 


29 


31 


28 


32 


O A 

30 


In this class Da 


Occasionally 


26 


27 


28 


24 


26 


how hard I have st 


Almost never 


15 


18 


13 


13 


15 


38* Doing well on tec, . 


Nearly always 


7 


5 


8 


9 


7 


In this class depends 


Often 


17 


11 


14 


16 


14 


on factors beyc 


Occasionally 


32 


31 


31 


30 


31 


my control 


Almost never 


44 


52 


48 


45 


48 


11. No matter av.v/ ^rd Stro agree 


11 


12 


11 


12 


11 


I work In this clas I 


Agree 


26 


28 


26 


26 


26 


can^'t do as well as 


Disagree 


46 


43 


45 


45 


45 


I would like Strongly disagree 


16 


18 


19 


16 


18 


Indices : 














Effort (avg. Items 31+16) 


Mean 


2.81 


2.84 


2.96 


2.87 


2.87 


Motivation (avg. Items 10+8) 


Mean 


2.56 


2.63 


2.65 


2.48 


2.59 


Efficacy (avg. Items 32+35) 


Mean 


2.91 


2.82 


2.97 


2.93 


2.90 


Futility (avg. Items 38+11) 


Mean 


2.06 


2.00 


2.05 


2.11 


2.06 


Number of students ** 




391 


478 


420 


405 


1694 



"Don't knew" responses treated as missing responses 
if Actual number for each Item depends on number of missing responses. 
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Table I 1-2 

Correlations of Effort Index with Other Measures of Students' Academic Effort. 



(Individual-level correlations 


In each subject 


and in 


all*) 




Items Correlated 


Biol 


Geom 


Engl 


Hist 


All 


Effort Index Items: 










Study thoroughly x Work hard 


.42 


.39 


.52 


.51 


.44 


Effort Index x: 












HoiiT'S SDpnt In stiiiiv AnH hnm^uork 


.40 


.27 


.25 




. J ^ 


Hoio^vofIc Hnnp on t'lmp 


.52 


.41 




.S2 
• j^ 


c 1 
• y 1, 


Afilc aiipfit^lnns in nljaais 


.33 


.35 




97 




Seek teacher's help 


.30 


.31 


.35 


.35 


.32 


Mind wanders In class 


-.34 


-.35 


-.34 


-.39 


-.36 


Late to class 


-.24 


-.13 


-.37 


-.18 


-.22 


Cut class 


-.24 


-.14 


-.32 


-.22 


-.22 


Numbers of students ** 


391 


478 


420 


405 


1694 



* All correlations statistically significant at p<-.05 level. 

Actual number for each item depends on number of missing responses. 
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Ou. oo.o„„ was their correlation, with Effort, which arc shown 1„ 
Table U-2. 

«fort exhibited statistically significant positive correlations with 
^o-rs spent m st^, or on ho^or.. having ho^or. .one o. tl.e, asking 
,u.stlo„s. and soliciting teachers' help. The correlations with having 
ho«„or. done on tl^ were partlcnlarl, strong. Effort also exhibited 
.CHscU.ny significant negative correlations with ..tuning out.- m class 

l«e to eUss. and cutting class, although correlations with the latter 
*wo variables were weak, possibly because of the lifted variation In 
Response to those ,ue.tlons. which we attribute to students' reluctance 
C..p.cuuy m District B, to ad^t to rule^breaUng behavior. Respite these 
lo« .or„aatlons. however, the general pattern evident In Table U-2 
e.«„rag.a us to regard the Effort Index as an Indicator of academe effort 
ien.r.1 as well as of efforts to study In particular. 

J^ujfeStgl .Motivation 

Ih« first step m our «.del development was to test our hypothesis 
^<^c «fort to study Is a positive function of academe «,tlvatl„n. To 
^e^urs motivation, we e^loyed two questionnaire Ite^: ho. l^ortant It 
- ^ the student to do well In the class (Its. 10) and the lowest grade m 
cxess tut would satisfy the student (Ite. 8). Distributions of student 

r«*|>oni,es t« these Iteiiia are shorn, m Table ll-l ■n. . . 

in jable II-l. The majority of students 

1" each subject repotted that doing .ell .as "v..^. < 

iug weii was very Important. Similarly the 

«.i.ru, of students in each subject except history reported that the lowest 
^rm. Chat would satisfy them In the class would be a B or better. The 

c, ^,r,at averaging .hem into an Index called Motivation. Means on this 
tiidft^ a^c ehovm in Table n-i. 
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Table II-3 

Correlations of Effort, Motivation, Efficacy, and I itlllty 
(Individual-level correlations In each subject and In all*) 



Items Correlated 


Biol 


Geom 


Engl 


Hist 


All 


Lowest grade x Do well 


.37 


.27 


.39 


.35 


.35 


Efficacy Index Items: 

Effort rewarded x Can predict 


.41 


.43 


.44 


.46 


.43 


Futility Index Items: 

wo concrox x can t do well 


.33 


.29 


.25 


.28 


.29 


Effort x: Motivation 


.41 


.33 


.47 


.40 


.40 


r<mcacy 


.28 


.27 


.49 


.25 


.31 


Futility 


-.06- 


.05- 


-.23 


-.08- 


-.09 


Motivation x: Efficacy 


.28 


.21 


.29 


.23 


.25 


Futility 


-.33 


-.30 


-.27 


-.32 


-.31 


Efficacy x Futility 


-.39 


-.28 


-.40 


-.44 


-.37 


First-order partial correlation coefficients, 
controlling on Motivation: 












Effort X Efficacy 


.19 


.22 


.42 


.18 


.25 


Number of students 


391 


478 


420 


405 


1694 



* All correlations except those marked are significant at p<-.05. 

** Actual number for each correlation depends on number of missing responses* 
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The functional relationship of student effort to student motivation 
was operatlonallred as the correlation of Effort with Motivation, As shown 
In Table II-3, correlations In each subject were positive and statistically 
significant. The hypothesis was confirmed. 

Students" Feelings of Efficacy versus Futility 

He also hypothesized that Effort Is a positive function of students" 
feelings of efficacy In obtaining rewards as a result of effort. The model 
predicted that efficacy would have a positive effect on effort, because the 
expectancy theory of work motivation predicts effort as a function of' 
subjective probability of success. 

To measure feelings of efficacy, we included four Items In the 
student questionnaire. Of these four Items, two were positive measures of 
efficacy and two were negative measures. The two positive Items asked how 
often the student felt that "If I study hard for this class, the effort Is 
rewarded" (Item 32) and that "I can predict how well I will do on a test as a 
result of how hard I have studied" (Item 35). Distribution of responses Is 
shown In Table II-1« The data show that about three fourths of the students 
In each subject felt that the effort Involved In studying hard for class 
tests was often or nearly always rewarded. However, only about 60 percent of 
the students In each subject felt that they often or nearly always could 
predict how well they would do on a test based on how hard they had studied. 

The two negative measures asked how often the student felt that 
"Doing well on tests In this class depende on factors outside my control" 
(Item 38) and how strongly the student agreed or disagreed that "No matter 
how hard I work In thl8 class, I can't do as well as I would like" (Item 11). 
As the distribution of responses In Table II-l shows, only a fourth at most 
of the students In each subject felt that doing well on tests often or nearly 
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always depended on factors beyond their control. A larger proportion of 
students— about 38 percent—agreed or strongly agreed that they couldn't do 
as well as they would like regardless of how hard they worked. 

Initial analyses of item relationships revealed that the negative 
measures exhibited a somewhat different pattern of correlations than the 
positive measures. As we reflected on the wording of these negative items, 
we sensed that they evoked feelings of "futility- more general than the 
positive items' specific reference to the rewards for studying for tests. 
The "futility" items probably tap some more long-lasting attitudes and 
feelings than the positive "efficacy" items. Hence we decided to distinguish 
between positive feelings of efficacy about the payoff of studying and 
negative feelings of futility about succeeding as a result of effort; we 
expected the latter to more somewhat more general to the personality of the 
student and the former to be more responsive to situational differences. 

Table II-3 shows the correlations of the two positive items and of 
the two negative items. The two positive items were averaged into an index 
called Efficacy and the two negative items into an index called Futility. 
Table II-3 also shows the correlations between the two indices. They wtre 
strongly negatively related, as we expected from the correlations among 
individual items. Both indices are employed in testing hypotheses about the 
predicted influence of feelings of efficacy on efforts to study (and, in 
Section III, in analyses of predicted influences on feelings of efficacy). 

Table II-3 also shows the correlations of Efficacy and Futility to 
Effort. Efficacy exhibited moderate positive and statistically significant 
correlations with Effort. In contrast, the predicted negative relationship 
between Futility and Effort was statistically significant only for students 
In English classes and for the whol,- sample, and even there it was weaker 
than any of the correlations of Efficacy with Effort. In geometry, the sign 
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of the correlation between Futility and Effort was even positive, although it 
was insignificant* These findings are consistent with the expectation that 
feelings of efficacy are significant positive influences on efforts to study; 
they do not in general, however, support the hypothesis that feelings of 
futility are significant negative influences on efforts to study. We will 
retain the Futility index in our analyses as a criterion variable interesting 
in its own right, but we cease to expect it to mediate the influence of class 
testing practices on Effort. 

Finally, Table II-3 shows the correlations of Efficacy and Futility 
with Motivation. The findings show that the correlations of Efficacy, with 
Motivation were positive and statistically significant, but they were never 
stronger than .29. The correlations of Futility with Motivation were 
negative and statistically significant and generally a little stronger than 
the correlations of Efficacy with Motivation. Apparently students who are 
motivated to do well also are somewhat more likely than other students to 
believe that they can do well. 

In order to make doubly sure that the positive relationship between 
Efficacy and Effort, which is a cornerstone for later analyses, was genuine 
and not a spurious result stemming from the confounding influence of 
Motivation, we computed the first-order partial correlation between Efficacy 
and Effort, with Motivation controlled. (Since Futility was not generally a 
significant correlate of Effort, we omit that index from this analysis.) The 
results, shown in Table II-3, confirm in general that the partial correlation 
coefficients, while smaller than the zero-order coefficients, remain positive 
and statistically significant. This analysis also supports the hypothesis 
that Efficacy has a positive influence on Effort. 
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Students^ Academic Aptitude 

It was Important to us to ensure that the relationships we observed 
were not attributable to the effect of differences In students' academic 
aptitude. Perhaps students with a long history of success in school have 
developed reinforced tendencies to work hard and thus have developed more 
effective and efficient study habits. Furthermore^ students who have 
succeeded In past courses are likely to feel rewarded by study. Conversely » 
students who have not done well In the padt may feel more hopeless about 
doing well. Hence for this reason also> the positive relationship of effort 
and efficacy night be spurious. The sole questionnaire item measuring 
aptitude was a question asking students what their grade oint average (GPA) 
was during the preceding year. This item was mentioned earlier in describing 
the characteristics of students in the sample. GPA Is not a pure measure of 
aptitude; it Is, among other things, also a measure of effort in past years. 
Given the likelihood that aptitude and the habit of effort will influence the 
variables In the model under development^ we include it here. Distributions 
of student responses to the question about GPA are shown In Table II-4. As 
already mentioned in connection with Table I-l> large majorities of the 
students in each subject reported having compiled an "A" or "B" GPA during 
the preceding year. 

Correlations of GPA with model variables are also shown in Table 
II-4. GPA is most strongly related to Motivation* Evidently, students who 
have done well in the past expect to keep doing well. The correlations of 
GPA with Effort are also moderately strong. Again, past study habits 
presumably carry over to the present. However, GPA is not related to 
Efficacy (expj^pt very weakly in English) and only weakly related to Futility. 
Controlling on GPA in addition to Motivation does little to change the 
relationship of Efficacy to Effort. The second-order partial correlation 
coefficients remain statistically significant* 
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Table I 1-4 

Students^ Grade Point Average and Its Correlates 
(Percentages of students selecting questionnaire responses, 
and Indlvldual-level correlations » In each subject and In all) 



Item Response 


Biol 


Geom 


Engl 


Hist 


All 


Distribution of responses: 










What was your grade 3.6-4.0 (A- to A) 


27 


27 


30 


.12 


24 


point average last 2.6-3.5 (B- to B+) 


50 


54 


47 


56 


52 


year? (6) ** 1.6-2.5 (C- to C+) 


20 


18 


18 


29 


21 


Below 1.6 (IH- or below) 


3 


1 


5 


2 


3 



Correlation coefficients: 



Zero-order coefficients: 



GPA x: 



Effort 
Motivation 
Efficacy 
Futility 



.33* 
.54* 
.05 



.20* 
.39* 
.04 



.41* 
.58* 
.14* 



.22* 
.49* 
.05 



-.20* -.22* -.30* -.21* 



.29* 
.51* 
.07* 
-.23* 



First-order partial correlation' coefficients, 
controlling on GPA: 

Effort X Efficacy .28* .27* .48* .24* .32* 



Second-order partial correlation coefficients, 
controlling on GPA and Motivation: 

Effort X Efficacy .21* .22* .44* .19* .26* 



Number of students *** 391 478 420 405 1694 

* p<-.05 

** "Don't know" responses treated as missing responses. 

*** Actual number for each item and correlations depends on number of missing 
responses. 
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Estimating the Model with Class Means 

Thus far we have concentrated on analyses at the Individual student 
level* Because the model ultimately alms to relate student variables to 
teacher practices that largely affect all members of a class, and because 
class stratification results In ecological segregation of student aptitude 
and motivation, we now replicate and expand the above analyses with class 
means of student measures* 

In Table II-5 we show the correlations among class means on Effort, 
Motivation, Efficacy, Futility, and CPA* The class-level relationships are 
usually as strong as, and often stronger than, tue Indlvldual-level 
relationships shown In Tables III-3 and III-4* The small number of classes 
Involved In correlations for each subject, however, make statistical 
significance more difficult to obtain* 



C ourse Tracking and Effort 

As described In Section I, the classes studied Included scue 
Identified as hlgh-treck or low-track classes* It Is Important to correct 
for such uneven stratification of courses in class-level analyses, because 
f^ome of the observed relationship among variables may be attributable to the 
segregation of more and less able students by track* We crer.ted an Index 
called Track by assigning a value of 1 to low-track classes, 2 to regular 
classes, and 3 to high-track classes* Table II-5 shows the correlation of 
Track to model variables for each subject* Track was moderately related to 
Effort, strongly related to Motivation, unrelated to Efficacy, moderately 
related to Futility, and very strongly related to CPA* 

In order to remove the Influence of tracking, we r ^::computed the 
correlations for the subsample of regular classes (Track«2)* These 



Table II-5 

Estimating the Model with Class Means of Student Responses 
(Class-level correlations In each subject and in all, 
for all classes and for ''regular" classes alone) 



Indices Correlated 




Biol 


Geom 


Engl 


Hist 


All 


Axx v>xaoses! 














Track x: 


Effort 


.38 


.40 


.46 


.41 


.34* 




Motivation 


.47* 


.79* 


.90* 


.15 


.65* 




Erricacy 


-•13 




"•27 


.15 


.04 




Vm - 4 1 4 ^ mm 

ruClllCy 




-• jV* 




-.02 


-.39* 




GPA 


• 90* 


• 92* 


.86* 


.86* 


.73* 


Lrrorc xz 


notlvatlon 


.42* 


.0 J* 


.56* 


-.05 


.45* 




Efficacy 


.33 


.67* 


.42* 


.21 


.43* 




Futility 


-.22 


-.62* 


-.61* 


.02 


-.36* 




GPA 


.36 


.30 


.43* 


-.06 


.27* 


Motivation x: 


Efficacy 


.27 


.48* 


-.06 


-.06 


.15 




Futility 


-.56* 


-.76* 


-.52* 


-.52* 


-.59* 




GPA 


.64* 


.66* 


.93* 


.69* 


.78* 


Efficacy x: 


Futility 


— • /U* 


-• / 


-•57* 


-•56* 


-•59* 




GPA 


1 Q 
— • 1 y 


• 1 / 


-.15 


-.29 


-.12 


Futility X 


GPA 


-•10 


-•45* 


-.47* 


-.33 


-.39* 


"Regular" Classes (Track-2): 












Effort x; 


Motlvatloa 


.37 


.01 


.18 


.13 


.23* 




Efficacy 


.49* 


.42 


.33 


.17 


.35* 




Futility 


-.27 


-.15 


-.35 


.01 


-.22 




GPA 


.09 


.17 


.00 


.18 


.09 


Motivation x: 


Efficacy 


.37 


.08 


.30 


.71* 


.18 




Futility 


-.52* 


-.54* 


-.34 


-.72* 


-.55* 




GPA 


.JO* 


—.14 


.74* 


.02 


• 68* 


Efficacy x: 


Futility 


-.27 


-.43 


-.89* 


-.70* 


— • c ... ■ • 




GPA 


.09 


.28 


.17 


-.15 


-.09 


Futility X 


GPA 


.08 


-.10 


-.11 


.19 


-.18 


Number of classes (total) 


16 


18 


18 


17 


69 


Number of regular classes 


14 


10 


13 


14 


41 



* p<-.05 
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correlations are also shown In Table II-5. What is apparent In this analysis 

Is that the relationship of Motivation to Effort almost disappears In this 

subsample. Only the whole-sample correlation Is significant. In contrast, 

the correlations of Efficacy with Effort remain significant at the 

whole-sample level, are still appreciable In geometry and English, and even 

Increase above the level of statistical significance In biology. Thus this 

relationship seems more robust than the relationship of Motivation to Effort. 

Finally, we recomputed the correlations for low-track classes In the 

one subject (geometry) with enough low-track classes (7) to permit 

correlational analyses. Here the correlations with Effort were as follows: 

Motivation .86 
Efficacy .84 
Futility -.82 

All three were statistically significant. Evidently the basic model holds 
for this sample of low^track classes. 

Summary 

We have Introduced Indices of Effort, Motivation, Efficacy, and 
Futility In developing a basic model of predictors of students'!* efforts to 
study. Using Indlvldual-level analyses, we found that the expected positive 
relationships of Motivation and Efficacy to Effort were statistically 
significant but that the expected negative relationship of Futility to Effort 
was weaker and was significant only In English and In the sample as a whole. 
Controlling on Motivation and GPA did little to diminish the positive 
relationship between Efficacy and Effort. 

Then we reanalyzed the model using class means of student data. In 
general, the relationships were stronger. When we restricted analyses to 
regular, untracked classes, however, the relationship of Motivation to Effort 
was noticeably diminished. Efficacy, however, still exhibited a positive 



relationship to Effort* These analyses encourage us to treat students^ 
feelings of efficacy as a promising mediating variable between teachers^ 
class testing practices and students^ efforts to study* 

III* Teachers^ Class Testing Practices and Student Efficacy and Effort 

Our analyses of effects of efficacy on effort warranted the Inference 

that a student^s feeling of efficacy was a positive Influence on a studenf^s 
effort to study* In this section we consider teachers'* class testing 
practices that may Increase students^ feelings of efficacy and therefore also 
Increase effort* 

Based on the rationale of a program for Integrating teaching and 
testing developed by one of the authors (Fielding and Schalock 1985), we test 
three hypotheses* First, we hypothesize that students^ feelings of efficacy 
and futility are functions of the level of clarity regarding test 
expectations created by teachers" practices In communicating test 
expectations and providing feedback about test performance* We also 
hypothesize that efficacy and futility are functions of the correspondence of 
tests to those expectations resulting from teachers" practices. In 
constructing tests* Finally, we hypothesize that students" feelings of 
futility are a function of the degree of teacher helpfulness after students 
do poorly on tests* 

For each hypothesis, we will examine correlations of student-report 
measures of teaching practices with our Indices of Efficacy, Futility, and 
Effort* Then we will Introduce teachei^report measures and examine 
correlations with student reports and with the criterion variables* The main 
analyses will employ class means of student responses to questionnaire Items, 
although we will refer to relationships among variables at the Individual 
student level where appropriate* 



Student Clarity and Teacher Coinmunlcatlon and Feedback 

We expected student efficacy and effort to be positively related, and 
futility to be negatively related, to student clarity about learning 
objectives. The more definite the student's knowledge of what to study, the 
more effective should be the study. We expected clarity In turn to be 
positively related to the student's experience of teacher communication about 
material to be covered on a test. Furthermore, assuming repeated test 
experience, we expected clarity to be positively related to the specificity 
of feedback of test results regarding material the student still needs to 
master. 

Students' clarity about learning objectives was measured by a single 
question asking students how often "I know what I am expected to be learning 
In this class" (Item 40). Students' experience of teacher communication 
about test content was measured by two Items asking how often "the teacher 
gives notice about what will be on a test enough In advance for me to prepare 
for It" (Item 41) and how often "the teacher makes clear the things I should 
be studying for the test" (Item 27). Students' perception of teacher 
feedback on test results was also measured by two Items. They asked the 
student how often "when I miss something on a test In this class, the teacher 
gives me specific feedback about what I need to study again" (Item 28) and 
how often "results from the tests In this class let me see easily what I need 
to review" (Item 17). The distributions of student responses on these Items 
are shown In Table III-l. 

The data show that the majority of students In each subject often or 
nearly always knew what th6y were expected to be learning,. Similar 
majorities reported that the teacher of the class often or nearly always 
communicated what would be on tests early enough and clearly enough. Test 



Table III-l 

Students' Reports of Clarity, Teacher Communication, and Teacher Feedback 
(Percentage of students In each subject and In all * 
selecting questionnaire responses) 



Questionnaire Item 


Response 


Biol 


Geom 


Engl 


Hist 


All 


Clarity: 












40. I know what I'm 


Nearly always 


38 


47 


43 


42 


43 


expected to be learning 


Often 


33 


36 


32 


30 


33 


In this class 


Occasionally 


22 


13 


19 


21 


18 




A 1 wnf\o f* novo i" 


7 




0 


"7 
/ 


0 


Communication: 














-41« The teacher in this 


i.icoi.xjr aXWayo 




D 0 


jO 




55 


class gives enough advance 


Often 


24 


22 


26 


*21 


23 


notice about tests for me 


Oc caslonally 


19 


17 


13 


13 


15 


to prepare for them 


Almost never 


8 


6 


6 


6 


6 


27. The teacher In this 


Nearly always 






50 


50 


50 


class makes clear the 


Often 


23 


31 


32 


24 


28 


things I should be 


Oc caslonally 


21 


16 


14 


18 


17 


studying for a test 


Almost never 


10 


3 


3 


6 


5 


Communication Index (avg. Items 41+27) 


*^ 1 n 


J. J u 


J. J 1 


J. JU 


J. 25 


Feedback: 














17. The results from the 


Nearly always 


9P 
ZO 


An 


Oft 




31 


tests In this class let me 


Often 


36 


36 


34 


34 


35 


see easily what I need to 


Occasionally 


26 


18 


29 


25 


24 


review to get a good grade 


Almost never 


10 


6 


9 


13 


9 


28« When I miss things on 


Nearly always 


11 


20 


17 


16 


16 


a testf this teacher gives 


Often 


25 


22 


23 


20 


22 


specific feedback on what 


Oc caslonally 


29 


33 


32 


28 


31 


to study again 


Almost never 


35 


25 


27 


35 


30 


Feedback index (avg. Items 17+28) 


2.47 


2.72 


2.55 


2.48 


2.56 


Number of students 




390 


478 


420 


405 


1694 



** Actual number for each Item depends on number of missing responses. 
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results were also seen by most students as Informative about what to study to 
get a good grade. On the other hand, only a minority of students lii each 
subject reported that teachers often or nearly always gave them specific 
feedback on test Items missed. From this last finding, we Infer that 
students are .ften left to Interpret test results by themselves. 

As shown In Table III-2, class-level correlations between the two 
Items measuring communication and between the two Items measuring feedback 
were sufficiently strong to warrant averaging each pair of Items Into Indices 
called Communication and Feedback, which we employ In analyses along with 
Item 40 as an Index of Clarity. Means on Co'iimunlcatlon and Feedback -In each 
subject are shown In Table III-l. 

We move now to class-level analyses with means on these Indices. 
First, as the data In Table III-2 show, these three Indices were strongly 
related In each subject. Only the correlation of Clarity to Feedback In 
English (.31) failed to reach statistical significance. This Is evidence 
that supports our expectations that students'^ clarity about learning 
objectives would be positively Influenced by the comimnlcatlon and feedback 
students received about test content. Moreover, students who reported more 
frequent communication also reported more frequent feedback. 

Table III-2 also shows that these Indices were strongly related to 
the Efficacy and Futility Indices In biology and geometry and — except for the 
correlations between Feedback and Futility — In English and history as well. 
In addition, Clarity and Communication generally were positively related to 
Effort; Feedback was strongly related to Effort only In geometry. Thus, 
based on analyses of student questionnaire data, the hypothesis that efficacy 
and futility are functions -of clarity resulting from communication and 
feedback Is confirmed. Furthermore, the positive relationships of 
Communication and Clarity to Effort suggest that Efficacy and Clarity are 
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Table III-2 

Correlations of Clarity, Communication , and Feedback 
with Efficacy, Futility, and Effort 
(Class-level correlations In each subject and In all*) 



Indices Correlated 


Biol 


Geom 


Engl 


HlsC 


All 


Communication Items: 










Gives advance notice x Makes clea 


• 88 


.89 


.67 


.65 


./6 


r eedDBcic items : 












Gives feedback x Test results Inform 


• 61 


.55 


.59 


.62 


.58 


Clarity x: Communication 


• 68 


.'.3 


.59 


.87 


.67 


Feedback 


• 68 


.66 


.31" 


.57 


.58 


Communication x Feedback 


• 84 


.80 


.52 


.68 


.69 


Axricacy x: Clarity 


.86 


.47 


.73 


.76 


.61 


Communication 


.79 


.70 


.55 


.66 


.65 


Feedback 


.75 


.79 


.51 


.44 


.53 


Futility x: Clarity 


-.49 


-.47 


-.68 


-.45 


-.54 


Communication 


-.59 


-.56 


-.66 


-.28- 


-.49 


Feedback 


-.53 


-.61 


-.10- 


.18- 


-.27 


Effort x: Clarity 


.42 


.53 


.61 


.26- 


.40 


Communication 


.17- 


.68 


.55 


.39- 


.44 


Feedback 


.02- 


.85 


.15- 


.28- 


.30 


Number of classes 


16 


18 


18 


17 


69 



* All correlations except those marked significant at p<-.05. 
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mediating variables In the Influence of Comnunlcatlon on Effort. 

The strength of these correlations prompted us to Investigate whether 
they might be affected by the segregation of some students Into high-track 
and low-track classes. The Track Index was not related to Clarity or 
Communication and only weakly related (negatively) to Feedback. When we 
Inspected the correlations for "regular" classes alone, we found the same 
overall pattern of coefficients. 

Analyses relying entirely on student reports about teacher practices 
run the risk of subjective response set, and they also are less Informative 
to teachers than analyses using teachers' own reports of their practices. 
Hence we turn to teacher questionnaire data on comnunlcatlon and feedback 
practices to corroborate the findings of the analyses with student data. 

Although teachers undoubtedly communicate explicitly and Implicitly 
about test content throughout the conduct of Instruction, we focused on 
specific and deliberate techniques to prepare students for tests. First, we 
restricted our questions to what we called "unit" tests rather than Including 
quick quizzes or final exams. The tea^' ar questionnaire asked teachers how 
regularly they communicated test expec .tlons to students at the beginning 
of, during, and at the end of units (Items 21a-c). Table III-3 ehawe the 
pattern of teachers' responses In each subject and In the sample as a whole. 

The majority of teachers In each subject reported regular use of one 
or more practices for comnunlcatlng expectations about tests to students. 
There were differences among subjects In the percentage of teachers reporting 
particular practices. For example, 76 percent of the English teachers, 
compared to only 28 percent of the geometry teachers, reported that they 
regularly Informed students at the beginning of a unit what they would be 
expected to know on the unit test. This difference may be attributed to the 
students' unfanlllarlty with the content of geometry units, compared to units 
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Table III-3 

Teachers^ Communication of Test Expectations and Feedback of Test Results 
(Percentage of teachers, In each subject and In all, 
selecting questionnaire responses) 

Questionnaire Item Response Biol Geom Engl Hist All 

Communication: 

21. In order to Inform students In 
this class about what they will be 
expected to know on a unit test, 
how often do you: 



a. 


Inform students at the 


Regularly 


44 


28 


76 


47 


48 




beginning of the unit? 


Sometimes 


50 


39 


24 


35 


37 






Rarely 


6 


33 


0 


18 


15 


b. 


give students sample 


Regularly 


50 


61 


52 


?9 


48 




test questions 


Sometimes 


38 


33 


35 


53 


40 




during a unit? 


Rarely 


12 


6 


12 


18 


12 


c. 


do a formal review 


Regularly 


56 


83 


82 


82 


76 




of knowledge, skills 


Sometimes 


38 


17 


18 


12 


21 




just before a unit test? 


Rarely 


6 


0 


0 


0 


3 



Feedbacl 



23c. When scoring unit tests, 


Regularly 


19 


29 


39 


35 


31 


how often do you provide 


Sometimes 


56 


59 


44 


53 


53 


written comments? 


Rarely 


25 


12 


17 


12 


16 


25a. When discussing test 


Regularly 


81 


89 


61 


71 


75 


results how often you Inform 


Sometimes 


19 


11 


39 


29 


25 


the class about Items on which 


Rarely 


0 


0 


0 


0 


0 



many students did poorly? 



Number of teachers * 16 18 18 17 69 

* Actual number for each Item depends on number of missing responses. 
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In other subjects, until It Is explained In class lessons. The finding that 
more gecoetry teachers than other teachers reported that they regularly gave 
students sample test questions during a unit may Indicate attempts to 
compensate for the Infrequency of advance communication of test expectations. 
Geometry teachers (and other teachers as well) built expectations about test 
coverage during the conduct of a unit. Finally, the large majority of 
geometry, English, and history teachers reported that they regularly 
conducted a formal review of unit material at the end of the unit, a day or 
so before the test. Only 1: biology did a substantial proportion (44 
percent) report that they conducted a formal review only "sometimes" 'or 
"rarely." 



each test; they also build expectations about future tests by the kinds of 
feedback they give regarding student test performance on each test. The 
questionnaire asked teachers how regularly they provided students with 
written and oral feedback about test performance. Responses to two 
questionnaire Items are relevant here. First, teachers were asked how 
regularly, when scoring unit tests, they provided written comments on test 
papers (Item 23c). Second, teachers were asked how regularly, when 
discussing test results, they Informed the class about parts of the test on 
which many students did poorly (Item 25a). As shown In Table III-3, only a 
minority of teachers In each subject reported regularly providing written 
comments on tests to supplement or elaborate on test scores, and several 
teachers reported "rarely" providing written comments. In constrast, the 
majority of teachers in each subject reported regularly Informing their 
classes about test Items on which many students did poorly, although 39 
percent of the English teachers reported doing this only "sometimes." No 
teacher reported providing such oral feedback only "rarely." 



Teachers not only communicate expectations about tests In advance of 




In order to see whether thest^ three Items on conununlcatlon and two 
Items on feedback could be combined Into composite Indices, we looked at the 
correlations, which are shown Table III-4, among these teacher practices for 
each subject and for the whole sample of 69 teachers. We found considerable 
Independence among use of these practices. Among the techniques of 
communicating to students about test expectations, the whole-sample 
correlation between notifying students at the beginning of the unit and 
giving sample questions during the unit was only .26. The correlation of 
these variables reached statistical significance only among English teachers 

The whole-sample correlation between giving sample questions and 
conducting a formal review at the end of the unit was .33; here. It was In 
biology alone that the correlation reached significance (r««73). Moreover, 
there was no significant correlation between beglnnlng-of-unlt and 
end-of-unlt notification either at the subject level or the whole-sample 
level* Likewise, the relationship between the use of written and oral 
feedback was not statistically significant. Hence we retained the individual 
items for correlational analysf>s with student variables. 

What was the relationship among these teacher practices and student 
indices of Communication, Feedback, and Clarity? Table III-4 shows the 
correlations for the whole sample of 69 classes and for each subject. There 
were no consistent relationships across subjects. We did find that informing 
students at the beginning of a unit was positively related to Clarity in 
geometry, and that giving sample questions during a unit was positively 
related to Communication in both biology and geometry. In addition, we found 
that informing the class about test items that many students missed was 
related to Feedback and Clarity in geometry and history but not in biology 
and English. Thus we are left with scattered and subject-specific findings 
regarding the relationship of teacher communication and feedback practices to 
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Table III-4 



(Class-level correlations In each subject and In a 


111 




Items Correlated 


DXUX 




Fncrl 

ling J. 


Hist 


All 


Teacher Reports: 












Communication Items: 












Beginning of unit x: During unit 


.26 


.30 


.73* 


1 6 




CillQ OX UuXl 


1 7 


• U J 




.17 


.08 


During unit x End of unit 


.73* 


-.08 


.28 


.23 


.33* 


Feedback items: 












Written comments x Discuss items 


.20 


.40 


.09 


-.16 


.08 


Teacher Reports x Mean Student Indices: 












Communication: 








• 




Beginning of unit x: Comiminication 


.01 


.20 


-.07 


-.01 


.04 


Clarity 


-.07 


.43* 


.24 


-.09 


.02 


Efficacy 


.19 


.29 


.34 


-.18 


.2 J* 


Futility 


-.16 






-.24 


-.17 


Effort 


.23 


.21 


-.08 


.07 


.17 


During unit x: Communication 


.43* 


.46* 


.11 


-.36 


.16 


Clarity 


.22 


.08 


.02 


-.52* 


.00 


Efficacy 


.22 


.38 


.18 


-.28 


.11 


Futility 




• H J 




.37 


-.08 


Effort 


.10 


.32 


-.21 


.09 


.06 


End of unit x: Communication 


.26 


.24 


-.20 


— OA 


• ID 


Clarity 


.31 


.30 


-.50* 




04 


Efficacy 


.12 


.16 


-.13 


-.40* 




Futility 


.24 


-.07 


.15 


.41* 


.17 


Effort 


• H 7 


.JO 




-.07 




Feedback: 












Written comments x: Feedback 


.32 


.12 


.16 


-.14 


0^1 


Clarity 


.29 


.09 


-.02 


-.23 


.05 


Efficacy 


.52* 


.07 


.18 


-.18 


.16 


Futility 


-.49* 


-.10 


-.07 


.05 


-.14 

. X "T 


Effort 


.32 


-.08 


.06 


.14 


.12 


Discuss items x: Feedback 


-.24 


.56* 


.02 


.66* 


.29* 


Clarity 


-.33 


.59* 


.01 


.54* 


.17 


Efficacy 


-.21 


.40* 


-.06 


.28 


.04 


Futility 


.20 


-.33 


.16 


.32 


.09 


Effort 


.25 


.39* 


.06 


.14 


.13 



Number of classes ** 16 18 18 17 69 

* p<-.05 

** Actual number for each correlation depends on number of missing teacher 
responses. 
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students^ perceptions of those practices. 

We checked to see whether these teacher reports of testing practices 
related to Efficacy, Futility, and Effort. Table III-A shows the 
correlations betveen the teacher practices and those student Indices. The 
correlations between each of the comxminlcatlon practices and Efficacy In 
biology and geometry were positive although not statistically significant; 
the correlation between beglnnlng-of-unlt communication and Efficacy for the 
sample as a whole was statistically significant. The data also show that the 
correlation between durlng-the-unlt communication and Futility was negative 
anu significant In geometry. These were scattered findings, however. 
Similarly scattered were findings regarding feedback practices and student 
Indices. 

None of the teacher reports was related to the Track Index, and the 
findings In Table III-A persisted when we restricted our analyses to regular 
classes alone. In sum, we have failed to Identify specific teacher practices 
that contribute strongly and consistently to student perceptions of good 
teacher communication and feedback. We have found, however, that such 
perceptions are positively related to students^ feelings of efllcacy and 
effort and negatively related to students' feelings of futility. From this 
discrepancy In findings, we conclude that further research Is warranted on 
teaching practices that are responsible for helping students to feel clear 
about what to study. 

Before turning to our second hypothesis, we note In Table III-A that 
the findings In history are anomalous. In that subject, communication during 
a unit was significantly negatively related to student Clarity, and 
communication at end of unit was significantly negatively related to Efficacy 
and positively related to Futility. This suggests that there may be 
something dysfunctional about these teacher communication practices in the 




U.S. history classes we studied. 



Student Perception of Correspondence and Teacher Construction of Tests 

Our second hypothesis predicted that efficacy would be a positive 
function-— and futility a negative function— of the degree to which tests In 
fact cover the material that the student has studied, which we call 
"correspondence." Correspondence v^^s measured by two Items on the student 
questionnaire: how often tests "cover what I expect them to cover" (Item 20) 
and how often test scores "closely reflect what I have learned" (Item 25). 
Distribution of responses on these Items Is shown In Table III-5. 

In general, the large majority of students in each subject reported 
that tests often or nearly always covered what they expected and that test 
results were accurate indicators of learning. The class-level correlations 
between these two items are shown in Table III-6; they were sufficiently 
strong to Justify averaging the two items into an index called 
Co rrespondence . 

The relationships between the indices of Correspondence, Efficacy, 
Futility, and Effort «ie pAso shown in Table III-6. They were. strong and in 
the direction hypoth^f^lced. They provide evidence that student perceptions 
of correspondence between what is taught and what is tested have a positive 
Influence on students'^ beliefs that study pays off and on efforts to study. 
Correspondence was not related to the Track index, and the strength of 
relationships was maintained when we restricted analyses to regular classes. 

As with communication and feedback, we used the teacher questionnaire 
to ask about practices that might Increase the correspondence of test content 
to student expectations. We focused on how teachers constructed tests. 
Firsts we ascertained whether teachers really "constructed" tests each year. 
We asked how many of the questions on their tests changed each year (item 31, 
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Table III-5 

Test Construction Practices and Correspondence of Tests and Expectations 
(Percentages of teachers and students. In each subject and In all, 
selecting questionnaire responses) 



Questionnaire Item 


Response 


Biol 


Geom 


Engl 


Hist 


A 1 1 

All 


Student Reports of Correspondence: 












20* The tepts given by 


Nearly always 


37 


56 


50 


41 


47 


the teacher in this class 


Often 


35 


2o 


31 


31 


31 


cover what I expect 


Occasionally 


20 


10 


16 


22 


17 


them to cover 


Almost never 


9 


5 


3 


8 


6 


25« The scores I get on 


Nearly always 


31 


31 


35 


33 


32 


tests in this class 


Often 


37 


38 


37 


31 


36 


closely reflect what 


Occasionally 


22 


22 


20 


26 


22 


I have learned 


Almost never 


10 


10 


8 


11 


10 


Correspondence index (avg* 


items 20+25) 


2.95 


3.13 


3.13 


2.94 


3.04 



Teacher Reports cf Test Construction; 

22« When you are constructing a unit test 
for this class, how often do you: 



c. Use a written list of 


Regularly 


40 


44 


28 


35 


37 


learning objectives In 


So rse times 


40 


6 


39 


41 


31 


developing test Items? 


Rarely 


20 


50 


33 


24 


32 


f. Establish standards that 


Regularly 


6 


25 


11 


0 


10 


students must meet before 


Sometimes 


50 


31 


61 


24 


42 


they move to a new unit? 


karely 


44 


44 


28 


76 


48 



Number of students * 391 478 420 405 1694 

Number of teachers * 16 18 18 17 69 

* Actual number for each Itesx depends on number of missing responses* 
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Table III-6 

Correlations of Test Correspondence and Test Construction Practices 
(Class-level correlations In each subject and In all) 



Items Correlated 



Mean Student Indices; 



Correspondence Items: 

Tests cover what expected x 
Results reflect what learned 



Correspondence x: 



Efficacy 
Futility 
Effort 



Biol Geom Engl Hist 



•67* .81* .59* 



.47* 



.79* .76* .71* .62* 
-.61* -.82* -.70* -.33 
.43* .80* .57* -.09 



All 



.57* 

.66* 
-.62* 
.46* 



Teacher Reports; 

Use written list x Establish standards 



.32 



.42* .22 -.27 



.19 



Teacher Reports x Mean Student Indices; 

Use written list x; Correspondence 

Efficacy 
Futility 
Effort 

Establish standards x: Correspondence 

Eificacy 
Futility 
Effort 



.36 


.15 


-.04 


.01 


.06 


.49* 


.25 


.17 


.15 


.22* 


-.19 


-.28 


-.08 


.30 


-.06 


.53* 


.19 


-.05 


.19 


.16 


.40 


.32 


.10 


.17 


.32* 


.49* 


.12 


-.03 


.10 


.15 


-.19 


-.07 


-.24 


-.07 


-.20* 


.18 


.51* 


.29 


.27 


.33* 



Number of teachers** and classes 16 18 18 17 69 

* p<-.05 

** Actual number for each correlation depends on number of missing teacher 
responses. 
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results not tabulated)* Many teachers in each subject responded that they 
changed "most" or "all" of their test questions from year to year; the 
proportions ranged from two thirds of the English teachers to only one third 
of the biology teachers* All teachers said they changed at least "some," as 
opposed to "virtually none," of their test questions each year* Hence our 
focus on test construction seemed justified* 

The questionnaire asked the teachers how regularly, when constructing 
tests, they used a written list of objectives to write test questions (item 
22c)* We reasoned that such a list of objectives was likely to help the 
teacher integrate instruction and assessment* The questionnaire also a'?ked 
the teachers how regularly, when constructing tests, they established 
performance standa;.'ds that students had to meet before moving on to the next 
unit (item 22f)* We reasoned that such standards would lead to 
correspondence in level of difficulty as well as coverage* Distributions of 
teacher responses to these two questions are shown in Table III-5* 

Roughly similar percentages — from 28 percent to 44 percent — of 
teachers in each subject reported "regularly" using a written list of 
learning objectives in developing test items. Greater percentages of 
geometry teachers than other teachers selected each extreme response* Hence 
the sample of geometry teachers was split on this measure* Geometry teachers 
also split more than other teachers on how often they established standards* 
Far more history teachers than other teachers indicated that they "rarely" 
established standards* 

What was the relationship between ther^e two test construction 
practices? Table III-6 shows the correlations for the whole sample of 69 
teachers and for teachers of each subject* Except in history, the 
relationship between using a written list of objectives and establishing 
performance standards was positive, reaching statistical significance in 
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geometry. We chose to retain the separate Items rather than combine them 
Into an Index. 

We next looked at the relationships of these test construction 
practices to students' perceptions of test correspondence with expectations. 
Table III-6 shows that establishing performance standards exhibited stronger 
correlations to Correspondence than using written lists of objectives, and 
the former correlation was statistically significant In the sample as a 
whole. 

We Investigated direct effects of teacher practices on class means of 
student Efficacy, Futility, Effort; these results, too, are shown In-Table 
III-6. There was a positive and statlstlcially significant relationship 
between both using written lists and establishing performance standards and 
Efficacy In biology, but other relationships were weaker. Also, each test 
construction measure was generally negatively related to Futility, and the 
correlation between establishing standards and Futility was significant In 
the sample as a whole. This Is Interesting because one might have surmised 
that standards would contribute to perceived futility. We also observe 
significant positive correlations between using standards and Effort In the 
sample as a whole and In geometry, and a significant positive relationship 
between using lists of objectives and Effort In biology. 

In sum, as with the analyses for the first hypothesis, we have found 
only scattered evidence supporting the claim that these testing practices 
Influence student feelings of efficacy, despite the strong relationships of 
student perceptions of correspondence between expectations and tests with 
Efficacy and Effort. The specific practices we measured are perhaps not the 
best Indicators of how teachers go about aligning tests with Instruction. 
Such alignment remains an Important subject for research. 
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Student Futility and Teacher Helpfulness 

In our third hypothesis, we restricted our attention to students' 
feelings of futility and posited that we expect that futility would be 
alleviated by teachers' follow-through by providing help after students had 
done poorly on tests. We did not expect there to be a relationship between 
teacher follow-through and students^ feelings of efficacy, which as measured 
depended on what a teacher did before a test rather than after It. 

The student questionnaire asked how often, "When a student gets a low 
score on a test In this class, the teacher makes sure he or she gets the help 
needed to do better" (Item 18). Distribution of student responses on this 
Item, which Is our Index of teacher helpfulness. Is shown In Table III-7. 
Only In geometry did a majority of students report that teachers often or 
nearly always provided help; In biology and history, only 40 percent of the 
students reported thus. Thus helpfulness, like feedback. Is experienced less 
often than communication and correspondence. 

Class-level correlations between perceptions of teacher Helpfulness 
and Futility were negative In each subject. As Table III-8 shows, although 
the class-level correlations were not significant In English and history. In 
general, students who perceived that teachers gave them the help they needed 
felt less hopeless about doing well. 

Like most other student perception Indices, Helpfulness was not 
related to the Track Index. When we recomputed the correlations for regular 
classes t the correlations between Helpfulness and Futility remained 
statistically significant for the whole sample and for biology. Moreover, 
although the correlation In regular geometry classes fell below the level of 
statistical significance, it was strong and statistically significant In the 
low-track geometry classes. (Geometry alone had enough low-track classes to 
permit use of correlational analyses In that subsample.) 
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Table III-7 

Teacher Helpfulness to Students Performing Poorly on Tests 
(Percentages of students and teachers, In each subject and In all, 
selecting questionnaire responses) 



Questionnaire Item 


Response 


Biol 


Geom 


Engl 


Hist 


All 


Student Reports: 












18. When a student gets a 


Nearly always 


17 


26 


19 


18 


20 


low test score, the teacher 


Often 


20 


26 


27 


20 


24 


provides the help needed 


Occasionally 


36 


28 


33 


35 


32 


to do better next time 


Almost never 


28 


20 


22 


27 


24 



Teacher Reports; 

27. When uany students do poorly on a 
unit test, how often do you: 



a. reteach the material 


Regularly 


7 


29 


39 


12 


23 




Sometimes 


73 


53 


56 


62 


61 




Rarely 


20 


18 


6 


25 


17 


b. move on rc keep to the 


Regularly 


20 


29 


24 


29 


26 


course schedule 


Sometimes 


60 


41 


47 


47 


48 




Rarely 


20 


29 


29 


24 


26 



28. When an individual student or small 
group of stiidents does poorly on a 
unit test, how often do you: 



a. give special remedial 


Regularly 


19 


18 


17 


31 


21 


Instruction outside 


Sometimes 


44 


82 


44 


31 


51 


class time 


Rarely 


38 


0 


39 


38 


28 


b. create special learning 


Regularly 


6 


12 


6 


0 


6 


activities In class besides 


Sometimes 


44 


25 


39 


50 


39 


regular class work 


Rarely 


50 


62 


56 


50 


54 


c. arrange for peer tutors 


Regularly 


6 


18 


0 


6 


8 




Sometimes 


50 


47 


61 


31 


48 




Rarely 


44 


35 


39 


62 


45 



Number of students * 391 478 420 405 1694 

Number of teachers * 16181817 69 

* Actual numbers for each Item depend on numbers of missing responses. 
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Table III-8 

Teacher Helpfulness: Correlations of Student Indices and Teacher Reports 
(Class-level correlations in each subject and in all) 



Indices Correlated 




Biol 


Geom 


Engl 


Hist 


All 


Mean Student Indices: 














Helpfulness x: 


Futility 




-.44* 


-•35 


-•10 


-•36* 




Effort 


• 13 


.69* 


• 29 


• 27 


• 36* 


Teacher Reports: 














Re teach x: 


liove on 


-•42 


-.57* 


-•67* 


-•40 


-•52* 




Remediation 


.14 


-.08 


-•09 


• 36 


• 08 




Special Activities 


• 01 


.07 


•48* 


.42 


• 23* 




Peer Tutoring 


• 07 


.04 


•46^« 


• 51* 


• 25* 


Move on x: 


Remediation 


• 00 


-.20 


•20 


• 11 


• 06 




Special Activities 


• 34 


•42* 


-•33 


• 08 


• 12 




Peer Tutoring 


-•18 


• 11 


-•07 


-.47* 


-•14 


Remediation x: 


Special Activities 


• 52* 


-•27 


• 13 


.23 


• 18 




Peer Tutoring 


• 27 


-•10 


-•09 


-•19 


• 00 


Special Activities x Peer Tutoring 


• 06 


-•30 


•47* 


• 10 


• 04 


Mean Student Indices with Teacher Reports: 












Helpfulness x: 


Re teach 


• 03 


•25 


•47* 


• 32 


• 31* 




Move on 


-•36 


-•40 


-•17 


-•05 


-•24* 




Remediation 


.14 


•01 


-.29 


.71* 


• 20* 




Special Activities 


• 02 


-•09 


• 55* 


• 04 


• 12 




Peer Tutoring 


• 64* 


•21 


• 57* 


• 09 


• 38* 


Futility x: 


Re teach 


• 38 


-•02 


-•58* 


• 15 


-•07 




Move On 


• 07 


•29 


.28 


-•31 


•07 




Remediation 


-•05 


• 34 


• 28 


-•09 


•06 




Special Activities 


•20 


• 09 


-•25 


.02 


• 02 




Peer Tutoring 


-•41 


-•05 


-•36 


-•20 


-•27* 


Effort x: 


Re teach 


.10 


•45* 


•45* 


• 02 


• 33* 




Move On 


.16 


-•57* 


-•11 


-•27 


-•24* 




Remediation 


.73* 


-•30 


• 14 


.10 


• 17 




Special Activities 


.36 


-•14 


•06 


-.16 


• 02 




Peer Tutoring 


.51* 


• 13 


• 10 


• 16 


.19 


Number of teachers* and 


classes 


16 


18 


18 


17 


69 



* p<-.05 

** Actual number for each correlation depends on number of missing teacher 
responses. 
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We now turn to teacher questionnaire Items regarding a number of 
practices that provide help to students who do poorly on tests. Although 
nearly all teachers agreed with a questionnaire Item stating that school has 
a special responsibility to students who are falling (Item 6b, results not 
tabulated), we recognize that the work load of high school teachers and the 
demands of the currlcular schedule place limits on what a teacher can do* We 
focused on possible responses In two situations: where many students In a 
class do poorly on a test and where only a few students do poorly • 

Teacher follow-through on test failure was measured by two Items 
asking what teachers did when many students did poorly on tests. 
Distribution of responses Is shown In Table III-7. First, teachers might 
reteach the material missed by many students (Item 27a) • Only 7 percent of 
the biology teachers (one teacher) and 12 percent of the history teachers 
(two teachers), compared with 29 percent of the geometry teachers and 39 
percent of the English teachers, retaught the material regularly. Second, 
teachers might move on to the next unit to keep to the schedule (Item 27b). 
There was no difference across subjects In the percentage of teachers 
reporting that they regularly moved on to the next unit In order to keep to 
the course schedule. Moreover, the majority of teachers clearly responded 
"sometimes" to both options. 

The correlation between the two measures of response to widespread 
student test failure Is shown In Table III-8. It Is evident that for the 
sample as a whole, there Is a negative correlation (-.52) between tendency to 
move on and tendency to reteach. This correlation Is negative In each 
subject area, although It reaches statistical significance only among 
geometry teachers and English teachers. 

In addition to responses to classwlde test failures, teachers were 
asked about a number of possible techniques for dealing with Individual 
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students or small groups of students who did poorly on tests (and who dldn^t 
require that the teacher delay the course schedule for the class as a whole). 
These techniques included giving special remedial instruction outside class 
time, creating special learning activities in class in addition to regular 
class work, and arranging for peer tutors (items 28a-r)« Distribution of 
teacher responses on these items is shown in Table III-7. What is 
immediately notable is that never does a majority of the respondents report 
regular use of any of these practices. In general, teachers are most likely 
to give special remedial instruction outside class time. 

How related are these practices for dealing with small groups of 
students performing poorly on tests? Table III-8 shows that providing 
remedial instruction and providing special learning activiti«js are positively 
related among biology teachers (r-«52), and the latter is positively related 
to arranging for peer tutoring among English teachers (r-«47)« Otherwise, 
and in general, these practices did not constitute a response syndrome. 

Table III-8 also shows that there are positive relationships of 
ret^aching to providing special activities and arranging peer tutoring in 
English and history. Against this, it must be noted that for geometry 
teachers there is a relationship between moving on and providing special 
activities (r-.42). Moving on does show negative relationships to arranging 
for peer tutoring, except in geometry. As before, it is wiser to consider 
the practices separately rather than combine them into an index. 

How do these teachei^reported practices relate to student reports of 
teacher helpfulness? The correlations in Table III-8 show that teachers^ 
reports of reteaching after classwide failure are positively related, and 
moving on negatively related, to students^ reports of teacher provision of 
help. Teacher provision of remedial instruction (except in English) and 
arranging for peer tutoring are likewise related to student perceptions of 
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helpfulness. Thus, In the area of teacher response to students' poor test 
performance, where both teachers and students report lower levels of teacher 
effort than in the case of communication, feedback, and correspondence, there 
are significant relationships between teacher reports of practice and student 
reports of perceptions. Evidently students' perceptions are sensitive to 
teacher efforts. In English, reteachlng, providing special learning 
activities, ana arranging for peer tutoring seem to Increase student 
awareness of teacher helpfulness; providing remedial Instruction outside 
class time seems most effective In history, and arranging for peer tutoring 
seems to Increase student awareness most In biology. 

But are these teacher practices effective In reducing futility and 
Increasing effort? Table III-8 shows the correlations of Futility and Effort 
with the five teaching practices. Reteachlng Is significantly negatively 
related to Futility only In English. This Isolated finding regarding 
Futility gains significance when we observe that, also In English, reteachlng 
Is positively related, and moving on negatively related, to Effort. Table 
III-8 also shows that reteachlng Is positively related and moving on 
negatively related to Effort In geometry and In the sample as a whole. These 
findings suggest that reteachlng when many students do poorly on a test Is an 
effective practice. 

With respect to teacher responses to Individual test failures. Table 
III-8 shows that the correlation of peer tutoring to Futility Is negative In 
all cases and statistically significant for the sample as a whole. The 
strongest subject correlation Is In biology (-.41), and we also observe that 
peer tutoring — along with providing remediation — Is significantly positively 
related to Effort In biology. Therefore, we suggest that peer tutoring may 
be an effective practice In that subject for reducing feelings of futility 
and Increasing study efforts of Individual students who are having difficulty 
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mastering the material. 



Summary 

We have found abundant evidence that students^ perceptions about 
communication, feedback, correspondence, and helpfulness are strongly 
Interrelated and strongly related to student feelings of the efficacy versus 
futility of study and to student reports of their own effort In study. On 
the basis of these findings, we would argue that Increasing student 
perceptions of what we regard as desirable class testing practices Is a 
promising avenue for Increasing feelings of efficacy and levels of effort. 

Increasing such perceptions depends, however, on Increasing certain 
teacher practices, and we cannot say that the practices we have Identified 
and analyzed are powerful and consistent levers on student perceptions. 
Moreover, these practices do not seem to differentiate teachers consistently; 
few of the practices were related to one another nearly as strongly as were 
class means of student perceptions of testing practices. On the other hand, 
the relationships we did find should be taken seriously by teachers who may 
want to try some particular practice that Is positively related to student 
efficacy and/or effort In their subject area. 

We expect that there are other, perhaps more diffuse, differences In 
teaching practices that affect hov students perceive and react to tests. It 
Is likely that the Informal culture of expectations built up over the year by 
teacher remarks and reactions operates somewhat Independently of the specific 
practices we have studied. It Is possible that the strong relationships 
among class means of student data are attributable to diffuse differences In 
teaching practices that heighten student awareness of test expectations and 
the relationship between test coverage and Instructional objectives. We did 
not ask explicitly about liking for or satisfaction with teachers, but the 




constellation of strongly-related class means on positively-toned 
questionnaire items suggests such a "halo" effect. (Such a halo, of course, 
may be wrll deserved by the teacher who manages to create such generalized 
positive perceptions of class tests.) 

We are not willing to abandon the specific practices described in 
this section, however. They remain strongly rooted in instructional theory 
rational in terms of the model of student motivation presented here. It 
may be that few of those practices are really implemented by teachers who 
responded that they "regularly" used them; teachers^ benchmarks of use and of 
regularity may be highly situation-bound and, in the case of the more 
ambitious practices such as providing special learning activities, may 
exaggeirate what are minimal efforts compared to the requirements of a mastery 
learning program. In fact, some measures that had been included in the 
questionnaire^ such as teachers providing subscores on tests to identify 
mastery of different sets of learning objectives and teachers adapting their 
instructional goals and teste to the needs of low-achieving students, were 
dropped from analysis after preliminary inspection. Either too few teachers 
reported ever using them> or teachers'* written comments on the questionnaire 
revealed interpretations disparate from the significance of such practices in 
our view of how to integrate teaching and testing. Even if one should be 
cautious in taking teacher self eports on these practices at face value, the 
practices retain an integrity in terms of improving high school instruction, 
and this warrants continued efforts to identify teachers who are using them 
and to study their effects on students. 
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IV. Influence of Policy and Collegiallty on Class Testing Practices 
The model of the relationship of high school teachers" class testing 
practices to students^ feelings of efficacy and efforts to study was 
developed In the context of an experimental study of a staff development 
Intervention to Increase teachers' use of the practices described In Section 
III* For a report of the findings of that study see Fielding, Shaughnessy, 
and Duckworth (1986). Because we were aware that the teaching practices of 
communication and feedback, test construction of tests around objectives, and 
response to poor test performance all Impose burdens on high school teachers 
already occupied by the demands of teaching five classes each day, we were 
Interested In the potential of colleglal assistance to support Increased use 
of such practices. Hence the Intervention Ipcirded attempts to foster 
colleglal cooperation among teachers In Improving the design and conduct of 
class testing. It also Included attempts to generate administrative support 
for such Improvements In teaching practice. The finding of that study — that 
trained teachers exhibited little change In practice— was attributed In part 
to the failure of colleglal cooperation and administrative support to mature. 
We concluded that future efforts to Improve class testing practices must be 
rooted In school and departmental policy decisions and must build stronger 
colleglal support than was achieved In the experimental study. 

In this section, we present evidence from our comparative data ov- 
four school subjects regarding the Influence of school and departmental 
policies and colleglal climate on the class tc*stlng practices of 
communication, feedback, purposive construction, and response to student 
failure. Because of the limited evidence presented In Section III that the 
specific testing practices measured by our questionnaire affect students" 
perceptions of the class and students' feelings of efficacy and levels of 
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effort, we also consider direct effects of policy and climate on student 
variables • 

In order to explore such possible Influences on teaching practices, 
we supplemented data from the teacher questionnaire employed In analyses In 
Section III with Interviews with high school administrators and subject^area 
department chairpersons. Those interviews focused on policies and practices 
that might affect class testing and on resources that might enable teachers 
to respond to poor student performance. 

We now summarize what we learned from those Interviews regarding the 
differences among the four schools and subjects regarding school and* 
departmental policies. Then we return to the questionnaire data for further 
analyses. 

School Administrative and Departmental Contexts of Class Testing 

In discussions with administrators, it became very clear that class 
testing was aimply not a concern of administrators* The only time they would 
become involved with tests was in disputes over grading, which were rare. 
None of the schools or departments had a policy about the format, coverage, 
or scoring of tests. Tests were within the domain of teachers' autonomy. 
Furthermore, testing was not generally perceived as a problem area. Evidence 
of poor student performance on tests tended to be treated less as a stimulus 
to instructional problem-solving than as an occasion to make moral judgments 
about the consequences of student laziness and lack of study and to terminate 
a student's enrollment in a partir-ilar course of study and place him or her 
in a less demanding course. 

As a result of District B's policies on teacher evaluation and staff 
development, the Interaction of administrators and teachers around 
instructional concerns may have been developed more completely in the two 
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schools In that district than In the two schools In District A. Several 
people In District B talked about Its three-stage teacher evaluation cycle. 
In which each teacher was evaluated cyclically on common teaching criteria, 
specific criteria selected by the evaluator, and specific criteria selected 
by the i , .r cher. This process of Interaction was Intensified In School 3 by 
the formal Involvement of department chairs In evaluation, which was unique 
In the four schools under study. In contrast, there was little discussion of 
teacher evaluation by Interviewees In District A. In any case, the formal 
evaluation procedure seems not to have focused on teotlng practices. 

In addition to Its systematic evaluation cycle. District B had 
fostered the Implementation of a comprehensive staff development program In 
teaching skills, whereas District A was only In the beginning stages of such 
a program. Hence administrators and teachers had been Interacting for 
several years about Instructional concerns In District B schools, especially 
School A, whereas such Interaction was more limited In the two District A 
schools. However, the staff development programs In question did not focus 
specifically on testing practices, although they did focus on some of the 
preparatory teaching behaviors, such as communication of objectives. 

In sum, the school administrative context of course testing was 
benign and nondirectlve. There was little evidence that schools had 
attempted to Influence this aspect of teaching by administrative means. 

In Interviews with chairpersons of the science, math, language arts, 
and social studies departments In each school, we Inquired about departmental 
policies and colleglal climate regarding class testing. The general picture 
was that there were no such policies. This picture was varied only In the 
case of sp ifl ourses that had recently undergone redevelopment, and even 
then the c^pe seemed only to provide options and guidelines for 

teachers rather than specify particular practices. Department chairs were 



often emphatic about the prerogative of the Individual teacher regarding 
judgments of the quality of student performance In scoring tests. In 
general, each teacher was free to set his or her own testing policy. There 
were cases of coordination among teachers of multiple-section courses, but 
department-level policy was nonexistent. The sentiments of many chairpersons 
were summed up In one science chair's reaction to our probing about 
departmental meeting discussions of testing issues: "I wish we had the time 
to go Into those issues, because they're Important. But we only meet once or 
twice a month and there are always budget, logistical, and state 
standardization matters to resolve." 

With respect to departmental collegia! climate, there were 
differences among the subject areas. The science and social studies 
departments were structured as loose federations. In science, there was a 
clearcut separation of the "life sciences" — predominantly biology — from the 
"physical sciences" in terms of teachers' certification and subject-matter 
identity; as a consequence, the department was unlikely to function as a unit 
with regard to particular courses. In none of the science departments was 
the chair a biology teacher. Likewise, in social studies departments, 
teachers of history, government, and economics courses were likely to 
identify with different academic disciplines and recall different preservlce 
and Inservlce training experiences. Two of the department chairs were 
history teachers and talked easily about that subject; two were government 
teachers and talked very tentatively about history. This Intradepartmental 
division was not apparent in math or language arts, however. Nonetheless, 
the chairs in those departments acknowledged that the governance of specific 
courses was likely to devolve on the teachers of those courses. 

The math chairpersons went into more detail about curriculum and 
instruction than did the science chairpersons, and it was evident chat each 
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math chair felt responsible for and comfortable with each course In the 
department. Math Is not a federation of different disciplines like science. 
Moreover, perhaps because the skills taught In the sophomore year are still 
critical In the senior year, there was more emphasis on mastery at each 
level. The School 2 chair was most emphatic about this. It may have been 
relevant that he had recently come to the high school from many years of 
teaching at the middle-school level. 

There were course outlines on file for each math course, but these 
were regarded as relics of recurrent periods of currlcular codification (the 
most recent having been the articulation of high school graduation 
competencies) rather than living forces In the conduct of courses. The text 
was the backbone of the course, although teachers were free to omit chapters, 
reorder chapters, and supplement the text as they saw fit. 

Some of the language arts departments had established detailed 
outlines for each unit In sophomore English; School A's department chair 
emphafilzed this effort. School 1 used the same final exam In all three 
le of sophomore English, but unit testing was up to the Individual 
teacher. 

When asked about resources for teachers with falling students, most 
department chairs responded with blank looks. There was the standard 
opportunity of the student to seek out the teacher during the lunch break or 
after school. There was also the possibility of altering the student's 
placement. Beyond this, the school offered little assistance. An exception 
to this generalization was School 1, where each department had a special 
resource center, always staffed by a teacher, which students could visit 
during one of their free periods each day. 

Thus we came to regard the department as such as a relatively weak 
Influence on teachers' class testing practices. Our focus came to rest on a 
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different basis for policy and colleglallty — the faculty teaching a 
particular course. We heard several anecdotes about team or cooperative work 
relationships among such teachers. For example, according to some science 
chairpersons, biology teachers would voluntarily share course outlines and 
materials, sometimes across all sections, sometimes in pairs. Hence we turn 
to the question of variation among teachers in interaction with colleagues 
and to its rela^^ionship to variation In teachers' class testing practices and 
the consequent student perceptions investigated In Sections II and III. 

Collegiality among Teachers of the Same Course 

Given the apparent f ruitlessness of investigation of departmental 
influences on testing practices, we follow the lead of several chairpersons 
and atteiiq>t to build a picture of collegicl influences on the foundation of 
individual teacher affiliations, especially within the faculty teaching each 
course. 

The teacher questionnaire asked several items about the working 
relationship among teachers of the same course. First, teachers were asked 
whether other teachers also taught the course about which they were answering 
the questionnaire. If so, they were asked how often they talked to other 
teachers of that course about course goals, course tests, and grading 
standards. The distribution of teacher responses to these items in each 
subject area is shown in Table IV-1. These three items were strongly 
intercorrelated, as shown in Table IV-2, and were averaged to create an index 
called Interaction. As the subject means on this index show in Table IV-1, 
biology teachers had the highest Interaction score and history teachers had 
the lowest. 

In addition to these general measures of collegiality among teachers 
of the same course, we asked about consultation with other teachers over 



Table IV~1 
Teachers' Reports of Colleglallty 
(Percentage of teachers, in each subject and in all, 
selecting questionnaire responses) 



Questionnaire Item 


Response 


Biol 


Geom 


Engl 


Hist 


All 


10. How often do you talk to other 












teachers of thib course 


about your: 












a* Course goals? 




20 


6 


0 


6 


8 




Of ten 


53 


31 


40 


6 


32 




Occasionally 
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by) 


7 1 


49 




Seldom/never 


7 


1 Q 


U 


lo 


1 1 


b« Course tests? 


Very Often 


27 


0 


0 


12 


10 




Often 


20 


38 


13 


0 


18 




Occasionally 




SO 


/ J 




c /. 
DH 




Seldom/never 


13 


13 


13 


35 


19 


c. Grading standards? 


Very Often 


21 


6 


0 


12 


12 




Often 


29 


19 


13 


12 


18 




Occasionally 


43 


50 


73 


53 


55 




Seldom/never 


7 


25 


13 


24 


18 


Interaction index (avg. 


items lOa-c) 


2.71 


2.19 


2.13 


2.00 


2.24 



22a. When constructing a test. 


Regularly 


12 


6 


11 


6 


9 


how often do you seek eivice 


Sometimes 


44 


78 


50 


41 


54 


from teachers about items? 


Rarely 


44 


17 


39 


53 


38 


27c. When many do poorly on a 


Regularly 


33 


19 


6 


12 


17 


test, how often do you 


Sometimes 


40 


89 


67 


53 


58 


consult other teachers? 


Rarely 


27 


12 


28 


35 


26 


28f. When a few do poorly on a 


Regularly 


25 


12 


19 


19 


18 


test, how often do you talk 


Sometimes 


62 


82 


69 


62 


69 


to other teachers? 


Rarely 


12 


6 


12 


19 


12 


9. Do you and other teachers of 














the course in question: 














a. Use the same text? 


Yes 


93 


93 


93 


65 


86 


b. Use the same course outlines? Yes 


73 


71 


60 


44 


62 


c. Use the same tests? 


Yes 


46 


44 


15 


19 


30 


Commonality Index (wtd. sum items 9a-c) 


3.85 


3.86 


2.46 


2.06 


3.02 


Number of teachers * 




16 


18 


18 


17 


69 



* Actual number for each item depends on number of missing responses. 
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Table IV-2 

Correlations among Teachers' Reports of Colleglallty 
(Correlations In each of four subjects and In all) 

Items Correlated Biol Geom Engl Hist All 
Interaction Items: 

Talk about goals x: Talk about tests .83* .68* .53* .67* .72* 

Talk about standards ,89* .62* .53* .76* .73* 

Talk about tests x Talk about standards .86* .77* .50* .89* .81* 



Interaction x: Seek advice on questions 
Consult on many failures 
Talk about lndlv« probs. 

Seek advice x: Consult on many failures 
Talk about Indlv. probs. 
Consult X Talk about Indlv. probs. 

Commonality Items: 

Use same text x: Use same outline 

Use same tests 
Use same outline x Use same tests 

Commonality x: Interaction 

Seek advice on questions 
Consult on many failures 
Talk about Indlv* probs. 

Number of teachers ** 
* p<-.05 

** Actual number for each correlation de 



.DO* 


.35 


.64* 


.80* 


.60* 


.61* 


-.19 


.30 


.67* 


.44* 


• 54* 


-.06 


.73* 


.52* 


.41* 


.54* 


.02 


.14 


.62* 


.39* 


.55* 


-.32 


.26 


.50* 


.33* 




.25 


.68* 


.77* 


.56* 


.45* 


.44 


-.22 


.42* 


.34* 


.27 


.25 


.12 


.37 


.29* 


.51* 


.32 


-.03 


.54* 


.40* 


.61* 


.43 


.38 


.62* 


.58* 


.31 


.45* 


.51* 


.54* 


.48* 


.30 


-.10 


.29 


.15 


.23* 


.12 


-.06 


.17 


.15 


.09 


16 


18 


18 


17 


69 



on number of missing resp ..ses. 
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specific testing Issues. The questionnaire asked about three occasions for 
consultation. In connection with reporting their practices In test 
construction, teachers were asked how regularly they sought advice from other 
teachers about test items (Item 22a). They were also asked how often they 
consulted other teachers when many students did poorly on a class test (Item 
27c). Finally, teachers were asked how regularly they talked with other 
teachers about Individual students' learning problems when those students did 
poorly on tests (Item 28f). Teachers were asked to answer these three 
questions regardless of whether they alone taught the course In question. 
(In fact, the teachers who said they taught the course alone were all 
responding In reference to a high-track or low-track class; In each case, 
there were other teachers of the subject In their department who could 
provide colleglal assistance.) 

Table IV-1 also shows distribution of responses on Items measuring 
specific consultation practices. Very few teachers In any subject reported 
seeking advice In test construction as a regular practice. The subject with 
the highest percentage of teachers who reported seeking advice "regularly" or 
at least "sometimes" was geometry; the subject with the lowest percentage of 
teachers checking those two responses was history, more than half of whom 
reported seeking advice "rarely." Slightly greater percentages of teachers 
In each subject reported consulting another teacher when many students did 
poorly on a test. Here, geometry teachers again were most likely, and 
history teachers least likely, to consult another ceacher at least sometimes, 
although biology teachers were most likely to consult regularly. This 
pattern was repeated In teachers' responses to how often they talked to other 
teachers about learning problems of Individual students who had done poorly 
on a test, although teachers were less likely to say they did this rarely 
than they were with consultation over classwlde testing failures. These 
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Items were moderately correlated but are retained as separate items for 
analysis with measures of the appropriate specific testing practices. The 
relationship of each of these Items to the Interaction Index is shown in 
Table All three were consistently related positively to the Index, 

except that the correlation of Interaction to the two Items referring to 
consultation after test failures was weakly negative among geometry teachers. 

Pursuant to our Interest In policy as a basis for Improved teaching 
practice, we were curious whether course colleagues developed common 
curricula and Instructional tools. Perhaps such decisions about 
Instructional policy might Increase teacher Interdependence and shared 
experience, leading to sustained colleglal interaction. We had no 
questionnaire data about the development of course materials, but we did have 
teachers'" responses to questions about whether they and other teachers of the 
course under consideration used the same text, the same course outlines, and 
the same tests (Items 9a-c). Percentages of teachers responding "yes" In 
each case are shown In Table IV-1. 

It Is apparent that use of a common text was prevalent In all courses 
except U.S. history. The majority of teachers of all courses except history 
also reported using the same course outlines. In no subject did a majority 
of teachers report using the same tests, however. In fact, this practice was 
rare In sophomore English and U.S. history. Correlations among these yes/no 
Items ~ shown In Table IV-2 ~ were universally positive, but the 
relationships between using the same text and using the same tests were not 
statistically significant. Given that frequency of colleglal interaction 
should be most Influenced by using the same tests, and least strongly by 
using the same text (a decision typically made only every five years), we 
constructed from these items a weighted additive index, called Commonality, 
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In which teachers received 1 point for using the same text, 2 points for 
using the same course outlines, and 3 points for using the same tests. Mean 
scores on Commonality, shown in Table IV-1, revealed that biology and 
geometry teachers were most likely to use common materials, while history 
teachers were least likely. 

Table IV-2 shows the correlation of the Commonality index with each 
measure of frequency of collegial interaction. Commonality is significantly 
related to the Interaction index and to the frequency of discussing test 
items with other teachers while constructing tests. When we probed 
correlations among individual items, it was apparent that using the same test 
indeed had the greatest influence on interaction. Table IV-2 also shows that 
Commonality had a weak relationship (significant only at the whole-sample 
level) to the frequency of consulting other teachers when many students did 
poor.l}^. Furthermore, there was no appreciable relationship to discussing 
individual students^ poor test performance with other teachers. In sum, 
there is evidence that collegial interaction in general is more frtequent 
where teachers have agreed to use common curricula and tests, but collegial 
interaction over cases of student test failure seems to derive from other 
sources. 

The main question for these analyses was whether collegiality was 
related to the use of the testing practices described in Section III. Table 
IV-3 shows the correlations of the Interaction index and, where appropriate, 
specific items to measures of those testing practices. With respect to 
measures of comiainicatlon and feedback, there were no significant 
correlations with the Interaction index at the whole-sample level, although 
in biology there were positive relationships between Interaction and all five 
measures, reaching statistical significance in the case of holding 
end-of-unit reviews and providing written feedback. A similar pattern of 
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Table IV-3 



(Correlations in each of 


four subjects and in all) 




Items Correlated 


Biol 


Geom 


Engl 


Hist 


Interaction x: 










Communication: 

beginnii»g of unit 
during unit 
end of unit 


• JH 

.44 
.66* 


— 1 

-.15 

-.26 


,Uh 
.35 
.29 


.34 
-.17 
.12 


Feedback: 

written comir'^nts 
discuss items missed 


,60* 
.16 


-.26 
-.45* 


.53* 
.37 


-.42* 
.28 


Test construction: 

use objectives 
establish standar^!* 


.65* 

A3 


.27 
.08 


.40 
.51* 


•15 
-.36 


Response to many failures 
reteach 
move on 


-.12 
-.31 


-.45* 
.46* 


.39 
-.28 


.04 
-.25 


Response to few failures: 
remediation 
speci^]l activities 
peer tutoring 


.16 
.04 
.43 


.14 
-.12 
.09 


.23 
.30 
.34 


-.13 
-.26 
.30 


Consultation x Test Construction: 










Seek advice on questions x: 

use list of objectives 
establish standards 


.32 

*^ 9 
• JZ 


.49* 

~.UJ 


.30 
.45* 


.38 
-.48* 


Consultation x Response to Failures: 










Consult on many failures x: 
reteach 
move on 


.02 
-.27 


.46* 
-.43* 


.60* 
-.18 - 


.24 
-.10 


Talk about indiv. probs. x: 
remediation 
special activities 
arrange peer tutoring 


.34 
.15 
.30 


-.07 
.31 
.24 


.19 

.45* 

.33 


• J / 

.00 
.17 


Number of teachers ** 


16 


18 


18 


17 



All 



.10 
.09 
.04 



.01 
.17 



.41 
.14 



.12 
.08 



.03 
.04 
.29* 



.32* 
.18 



.28* 
-.23* 



.25* 
.22* 
.25* 



69 



* p<-.05 

** Actual number for each correlation depends on number of missing responses. 
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posltlv.i relationships was observed in English, where only the relationship 
with providing written feedback was significant. Relationships were mixed in 
history, where the only significant relationship was negative, indicating 
that more frequent interaction was associated with less frequent written 
feedback. This anomaly was more pronounced in geometry, where all the 
correlations were negative, the correlation with providing oral feedback 
significantly so. This suggests that while collegiality in biology may 
reinforce the communication and feedback strategies studied here, 
collegiality in geometry may undermine them. 

We turn next to teachers' practices in constructing tests. Teachers' 
reports of using written lists of objectivep in constructing tests were 
significantly related to the Interaction index (r=.41) and the item on 
seeking advice on test questions when constnicting test.i (r«.32). Since such 
lists are teaching tools like the course outlines included in the index of 
Commonality, this finding suggests that lists are examples of emergent 
curricular policy among interacting course colleagues. Teachers' reports of 
establishing performance standards for tests, however, were not consistently 
related to either measure of collegiality. Given the findings in Section III 
that performance standards were more strongly related to student perceptions 
than lists of objectives, this is disappointing. Perhaps performance 
standards are not usually codified and shared with other teachers, a 
speculation consistent with department chairs' remarks that judgments about 
student performance were even more closely guarded ,?s professional 
prerogatives than the design of tests. 

The third area of testing practice under study was teachers' response 
to poor student performance on tests, which we differentiated into widespread 
and isolated student test failure. In the case of widespread failure, 
teachers' reports of reteaching material were positively related, and 
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teachers" reports of moving on to adhere to the course schedule negatively 
related, to the frequency of consulting other teachers In such cases. The 
direction of correlation was consistent across subjects, although only In 
geometry as well as the whole sample were the coefficients statistically 
significant. Given this finding In geometry, it was very surprising to see 
that each of these teaching practices was significantly related the opposite 
way to the Interaction Index, where more frequent Interaction was associated 
with moving on rather than reteachlng. It is recalled that consultation of 
other teachers was not related to Interaction in geometry. It Is also 
recalled that Interaction was negatively related to all communication and 
feedback measures In geometry. This Is further evidence that general 
colleglallty In that subject may undermine the teaching practices herein 
advocated, even though specific consultation In response to widespread test 
failure sustains the practice of reteachlng. 

In the cases where individual students did poorly on tests, all three 
measures of teacher response — providing remedial instruction outside class, 
providing special learning activities in class, and arranging for peer 
tutoring — were positively related at the whole-sample level to the frequency 
of discussing such students' learning problems with other teachers. The 
correlations, although statistically significant, were weak, however, and in 
general the subjecc-level correlations were not statistically significant. 
Nor were there consistent relationships to the Interaction index, which was 
related significantly only to teachers' reports of arranging peer tutoring. 
As in the case of widespread test failure, specific collegial Interaction 
seems more potent an influence on teacher response than does general 
colleglallty. 

Given the findings in Section III that student percepti ons of teacher 
communication, feedback, correspondence, and helpfulness were far stronger 



correlates of students' feelings of efficacy and effort than were the 
ceachers' reports of such practices, we speculated that the specific teaching 
practices Included In the teacher questionnaire may not encompass the ways in 
which a collegial climate influences teachers' integration of teaching and 
testing for students. Hence we probed relationships of collegiality to the 
student variables included in the model. Table IV-A shows the correlations 
of the Interaction index and the three specific measures of collegiality to 
those student variables. 

The Interaction ind^x exhibited statistically significant 
relationships to student perceptions only in biology and geometry. However, 
the relationships were opposite from one another* In biology, there were 
positive relationships between Interaction and student perceptions of 
Comminication^ Feedback, Clarity, and Correspondence and student feelings of 
Efficacy. This accords with some science department chairpersons' emphasis 
on curriculum-building among biology teachers as a positive factor in 
instruction. In contrast, in geometry, there were negative (and 
statistically significant) relationships between Interaction and students' 
perceptions of Feedback and Correspondence and students' feelings of 
Efficacy. There was also in geometry a positive (and statistically 
significant) relationship betw**e?i Interaction and students' feelings of 
Futility. This accords with the picture we have developed in this section of 
the adverse effect of collegiality on the integration of teaching and testing 
in geometry. It is possible, of course, that hidden factors are producing 
the surprising correlations in geometry; we ruled out one, however, in our 
findings that tracking, most pronounced in geometry in this study, was not 
the source of these findings. 

With respect to the more specific teacher consultation practices, we 
found that the practice of seeking advice on test quest tan« was positively 



Table IV-4 

Correlations of Teacher Coliegiality Reports and Mean Student Indices 
(Correlations in each of four subjects and in all) 

Items Correlated Biol Geom Engl Hist All 

Interaction index x: 



Communication 


.61* 


-.38 


.20 


.15 


.13 


Feedback 


.54* 


-.55* 


.02 


.32 


.10 


Clarity 


.64* 


-.20 


-.19 


.25 


.14 


Correspondence 


.69* 


-.54* 


.16 


-.12 


.02 


Helpfulness 


.41 


.00 


.20 


.35 


.19 


Efficacy 


.64* 


-.55* 


-.11 


.15 


.08 


Futility 


-.24 


.45* 


.15 




.09 


Effort 


.40 


-.38 


.02 


.23 


.02 



Seek advice on test items x: 



Communication 


.45* 


.08 


.14 




.14 


Feedback 


.18 


.09 


-.09 


.11 


.13 


Clarity 


.37* 


.41* 


-.01 


-.16 


.22* 


Correspondence 


.56* 


.00 


.21 


-.37 


.16 


Helpfulness 


.21 


.18 


.05 


.17 


.19 


Efficacy 


.41 


.02 


-.04 


-.2-^ 


.04 


Futility 


.02 


-.16 


-.26 


.28 


-.06 


Effort 


.35 


.15 


,30 


.02 


.21* 



Consult on many failures x; 



Ccmmunlcat ion 


.54* 


.21 


.55* 


.12 


.32* 


Feedback 


.32 


.50* 


.39 


.55* 


«44* 


Clarity 


.30 


.40 


.19 


.23 


.26* 


Correspondence 


.56* 


.39 


.43* 


.05 


.32* 


Helpfulness 


.24 


.47* 


.40* 


.41* 


.25* 


Efficacy 


.37 


.18 


.43* 


.30 


.27* 


Futility 


-.21 


-.07 


-.42* 


.20 


-.12 


Effort 


.24 


.61* 


.41* 


.21 


.30* 



Talk about indiv. probs. x: 



Communication 


.22 


-*07 


.11 


.28 


.14 


Feedback 


.11 


.06 


.12 


.54* 


.23* 


Clarity 


.63* 


-.25 


-.04 


.28 


.20 


Co r respondence 


.32 


-.02 


.20 


-.04 


.12 


Helpfulness 


.23 


.05 


.30 


.46* 


.26* 


Efficacy 


.33 


.11 


.25 


.■!4 


.25* 


Futility 


-.11 


.13 


-.05 


.17 


.03 


Effort 


.52* 


.01 


.05 


.46* 


.25* 



Number of teachers ** and classes 16 18 18 17 69 

* p<-.05 

** Acta&l number for each correlation depends on number of missing teacher 
responses • 
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related at the whole-sample level to the frequency of discussing such 
students' learning problems with other teachers. The correlations, althougl 
statistically significant, were weak, however, and in general the 
subject-level correlations were not statistically significant. Nor were 
there consistent relationships to the Interaction index, which was related 
significantly only to teachers' reports of arranging peer tutoring* As in 
the case of widespread test failure, specific collegial interaction seems 
more potent an influence on teacher response than does general coiiegiality. 

Given the findings \n Section III that student perceptions of teacher 
f oaimun^.cf»tion, feedback, coriePncMdence, and helpfulnes? were far stronger 
correlates of st» cents' feelir.gs of efficacy and effort than were the 
tc:achejr3" reports of cuch practices, we speculated that the specific teaching 
practices incluJed In the teacher questionnaire may not encompass the ways in 
which a collegial climate influences teachers' integration of teaching and 
testing for students. Hence we probed relationships of coiiegiality to the 
student variables included in the model. Table IV-4 shows the correlations 
of the Interaction index and the three specific measures of coiiegiality to 
those stiident variables. 

The Interaction index exhibited statistically significant 
relationships to student perceptions only in biology and geometry. However, 
the relationships were opposite from one another. In biology, there were 
positive relationships between Interaction and student perceptions of 
Comnunication, Feedback, Clarity, and Corresponclt^.ice and student feelings of 
Efficacy. This accords with some science department chairpersons' emphasis 
on curriculum-building among biology teachers as a positive factor in 
instruction. In contrast, in geometry, there were negative (and 
statistically significant) relationships between Interaction and students' 
perceptions of Feedback and Correspondence and students' feelings of 



Efficacy. There was also in geometry a positive (and statistically 
significant) relationship between Interaction and students' feelings of 
Futility* This accords with the picture we have developed in this section of 
the adverse effect of collegiality on the integration of teaching and testing 
in geometry. It is possible, of course, that hidden factors are producing 
the surprising correlations in geometry; we ruled out one, however, in our 
findings that tracking, most pronounced in geometry in this study, was not 
the source : these findings. 

With respect to the more specific teacher consultation practices, we 
found that the practice of seeking advice on test questions was positively 
related at the whole-sample level to students' perceptions of Clarity about 
what they were expected to learn and to students' reports of Effort. As with 
the findings with the Interaction index, these two correlations were 
strongest in biology. However, unlike the Interaction findings, no contrary 
correlations were observed in geometry, where the sign of each of the (very 
low) correlations was the sajne as in biology and where the correlation with 
Clarity was statistically sign- ficant. 

Particularly impressive were the findings regarding teachers' reports 
of consulting other teachers about classwide test failures. This measure was 
significantly and positively related at the whole-sampi. level to students' 
perceptions of communication, feedback, correspondence, helpfulnesG 
efficacy, and effort. Furthermore, these correlations were i^irly consistent 
and often statistically significant in each of the subjects. That these 
correlations are stronger than correlations of consultation with teachers' 
reports of specific practices and are not restricted to students' perceptions 
that teachers gave them the help they needed to do better after performing 
poorly on a test suggests that this teacher practice signifies some approach 
to instruction that pays off handsomely in terms of student response. 



Finally, teachers' reports of talking to other teachers about 
Individual students' learning problems also exhibit positive correlations to 
student perceptions of feedback, helpfulness, efficacy, and effort. In this 
case, however, the whole-sample correlations are weaker than In the preceding 
case and the subject-level correlations are rarely significant. 

Overview of Findings and Implications for Research and Practice 

In this final section, we have extended the model of Influences on 
students' feelings of efficacy and level of effort to Include the working 
relationship© among teachers. We found no Indications of Instructional 
policy at either the school or departmental level that would promote thp 
class testing practices that were the focus of this study. Moreover, we 
found colleglal Interaction at the department level to be limited, often 
limited to administrative matters or compliance with state requirements, anv 
handicapped in science and social studies by the diverse disciplinary 
loyalties of teachers. Therefore, we focused our investigation on the 
working relationships of teachers, particularly among teachers who taught the 
same course. 

Collegiality among teachers was measured in terms of frequ of 
talk among teachers of the same course (the Interaction index) and frequency 
of specific consultation practices. We found Interaction and consultation on 
test construction related to Commonality in use of text, course outline, and 
tests, and we speculated that the testing policy that emerges at the level of 
teachers of the same course may sustain colleglal interaction. However, 
relationships among Interaction and consultation measures and class testing 
practices proved inconsistent, although some of the specific consultation 
measures seemed to have a more generally positive relationship to testing 
practices than did the Interaction index. As we explored the relationship of 



collegiality to the student variables, however, we found more consistent 
effects, except in geometry, in fact, one of the consultation 
measures — consultation In response to classwlde test failures — exhibited 
strongei overall relationships to student variables than did teacher reports 
of testing practices discussed In Section III. We speculate that this 
measure Is tapping some characteristic of teachers-- perhaps 

conscientiousness, problem-solving orientation, or openness to learning from 
mistakes — that Increases the effectiveness of class testing without 
necessarily affecting the specific testing practices we measured. That this 
consultation measure did not specify that the colleague taught -he sdme 
course suggests that collegiality based on afl laity may be at least as 
productive as collegiality based on teaching the same course. 

The strength of the relationships among the student variables 
presented In Sections II and III warrant further research on teacher 
practices that Influence those variables* The limited evidence that the 
teaching practices measured in this study are influential needs to be 
followed up by experimental manipulation of those practices that goes further 
than the staff develo/,i;Tient program described in the report by Fielding, 
Shaughnessy, and Duckworth (1986). Teaching practices that increase 
students^ awareness of feedback and expectation of teacher help are 
particularly important. Increasing teachers'* commitment to providing 
feedback and help, and increasing students'* commitment to using such feedback 
and help to increase their mastery of material inadequately learned the first 
time around, seem logical targuts for experimentation. Clearly, such 
commitment v"lll depend on greater resources than are available, given present 
school arrangements and work loads. 

The evidence that teacher collegiality is related to student feelings 
of efficacy and levels of effort suggests that school and departmental 



leadership is needed to tievelop such collegial interaction. This study does 
not Inclcate the advisability of attempting to impose school or departmental 
testing policies, however, because teachers clearly would resist 
regimentation of what they regard as a professional right. Instead, 
encouraging and allowing teachers to collaborate with their colleagues to 
bring more rationality to their testing may be a more fruitful strategy for 
increasing students' feelings of efficacy about studying for tests and their 
consequent level of effort. 
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1. Student Questionnaire 

2. Teacher Questionnaire 
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HJjSji School ClasB Testing Study — Student Questionnaire 



h-^ u1 "V««»*'«:"'»8 « "tudy of class cesclng practice. In .everal OregoA high .choola. We would like to 

i^v^ IT y~ '"1. period. >. one at'your echo;i wtu ever earS 

rtlZ thl. queatlonnalre, so please answer honestly and oi^letely. We will .hare s^rles^f 

ci«88 responses with teachers In the spring to help them think about their teatlns p ractlcea. 

fc'^r^K*" P;*"'**" igth of thla page. Mark your answer with a « pencil on the aep.rate answer f orn. 

Next to the nuBh-T for each question, please fill iTTEhernPcTT^l^eFThe-litt^hZt-^I^herf^ 



1. What grade are you In? 



9, 



A. 9th 

B. lOth 

C. ilth 



D. 12th 

E. Other 



2, Are you male or femaleT 

A. Male B. Fcmais 

3, What are your main claases? 

A, College preparatory subjects 

B, Other subjects 

C, Don't know 

A. What do you plan to do after high school? 

A. No special plans 

B. Get a full-tine Job or Join military 

C. Go to a 2-year college or voc. program 

D. Go to a 4-year college 
£. Other 

5, How far did your parenta or guardlana 
go In school? 

A, Neither finished high school 

B, One or both graduated from high school 

C, One or both attended college 

D, One or both graduated from college 
E« Don't know 



For this class » how maoy boura a week do yoii spend 
outside class tine studying or 7olng homework? 

A, 1 hour at most a week 

B, About 2*3 hours a week 

C, About 4*5 hours a week 

D, More than 5 hours a week 

E, Don't know 



10. 



6. 



What was your grade point average for all 
your classes last year? 

A. 3.6 - 4^0 (A- to A) 

B. 2.6 -.3*5 (B to B+) 

C. 1.6 - 2.5 (t to C+) 
Below 1#6 (Df or below) 

E. Don't know 



For questions 7-15, please select the most 
accurate anower for the class you are In thl*. 
Period. ' • 

7» Which statement best describes your 
rcaifon for taking this class? 

A. It Is required or was recommended by 

a counselor or teacher 

B. I wanted to take It 

C. Don't know 

8« What Is the lowest ^^rade you would be 
satisfied with In this class? 

A. A 

B. B 

C. C 

D. D 

E. Don't know 



iE RJ C Q TO aassTigj. 9 gw this side 



How Important to you Is It to do well 
In this class? 

A. Not Important 

B. Somewhat Important 

C. Very Important 

BE SURE TO CO TO ITEM 1 1 ON YOUR ANSWER FORM, 

!!• How much do you agree or disagree with this statement: ^'No 
matter how hard I work In this class, I can't do as well as I 
would llkrt." 

A. Strongly agree 

B. Agree 

C. Disagree 

D. Strongly disagree 

12. How useful after high school do you sxpsct what you learn 
la this subject to be? 

A* Not useful 

B* Somewhat useful 

C* Very useful 

D* Don't know 



13. 



Hov often vould you soy you hsye skipx>ed 
or cut this closB? 

A. Hardly ever 

B« About once a month 

C« About once every couple of weeks 

D. About once a week or more 

E« Don't know 



lA. How often are you late to this class? 
A« Hardly «v«r 

B« About once every couple of weeks 
C« About once a week 

D. More than once a week 

E. Don't know 



15. 



On how many of the tests in this class 
so far have you done well? 



A. 
B« 
C. 
D. 



Hardly any of the tests 
Half of the tests at most 
More than half of the tests 
Nearly all of the tests 
Don't knov 



BEST COPY AVAILABLE 
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gUASE TOM TO THB OTHKR SIDE WHEW TOtf FIHIgH THIS SIM 



A-1 



Please decide how often atatemente 16-41 are true In the clasfi 
» you a:fe in this perlDd> Mark the matching circle on 
the answer fonn. Be sure to start with Itea 16 on the form. 
If yew don't kn<^ the answer to a question, skip lt# 



BEST COPY AVAILABLE 
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I work hard In this class. 



17. The results fro© the tests In this clsss let see e«tf<ly what 
t need to review; 

18. When a student gets a low score on a Cesjt In this class, the 
teacher makes sure he or she gets the help needed to do better. 

19. Assignments In this class have to be done In too short a time. 

20. The tests given by tuo teacher In this class cover what I 
expect thera to cover. 



21, 



I have my homeworlc done when 1 come to this class* 



22. Vhen a student gets a low score on a test In thio class, the 
teacher gives makeup work. 

23. When I'm not understanding the material for this class, I 
seek the teacher's help after class or outside class time. 

2A. My mind wanders during lessons In this class. 

25. The scores I get on tests In this class closely reflect what 
X have learned. 

26. I understand what the teacher Is talking about during this class. 

27. In this class, the teacher makes clear the things I should be 
studying for the test. 

28. When I miss something on a test la this class, the teacher gives 
me specific feedback on what 1 need to fi>tudy «galn« 

29. When a student gets a low score on a test 1» thl« class, the teacher 
has him or her work with ancther student to Imam the material. 

30. I ask questions In lessoaa In this class when I don't understand. 
BE SURE TO GO TO ITEM 31 ON YOUR ANSWi:: l^ORM. 

31. Before a test In this class, I 9fMt/ frhe material thoroughly. 

32. If I study hard for this class, the effi^vrt U .rewarded. 

33. It's possible to get the teacher of this c!«»s to reduce 
the amount of material to be covered ol a '^-^ct. 

3A. When a student In this class shows that i test qveatlon was 
unclear or unfair, the teacher revises teftL ttsccrcs. 

35. I csn predict how well I will do on a test, in this class 
based on how hard have studied* 

36. The work In this class Is difficult for m«« 

37. The tests In this class are harder than the teacher's classwork 

and homework assignments, 

38. Doing well on tests In this class depends oa factors outside 

my Control. 

39. I find the subject matter Interesting In thfs class. 

^0. I know what I'm expected to be learning In tidci class. 

^i. In this class, the teacher gives notice aboot what will be 

on a test enough In advance for me to prepare for It. ^ 
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Alnost 
Never 



A 

A 



A 
A 

A 

A 



A 
A 

A 
A 



Almost 
Never 

A 

A 

A 



A 
A 



A 
A 



Occasion- 

B 
B 



B 
B 

B 
B 



R 

B 

B 
B 



B 

Occaslon*- 
ally 

B 

B 
B 



B 
B 



B 
B 



Often 

C 
C 



C 
C 

C 
C 



C 
C 

C 
C 



Often 
C 
C 
C 



C 
C 



c 
c 



Nearly 
Always 

D 
D 



D 
D 

D 
D 



D 
D 

D 
D 



Nearly 
Always 

D 

D 

D 



D 
D 



D 
D 



^TH^ TOU* PLEASE RETURN YOUk aNSW FORM TO THE MANILA ENVELOPE PROVIDED TO THE TEACHER. A-2 



WH PROJBCt OH nSTlIC W m SCHOOL COURSES 
TIACm PSTIONIUIIIE 

• Mtt^iUy I, cm. Extri ipict li prorldid for you to wrlti cowxnti or 

K Ion 1117 rem hAtrc you been tMchiiii lo thli ichoolt 

2« fcif 1117 acpiriu pripirttloM do you hiTi eich day? 
3. lou Msy itudeoti do you tuch over tbt vhoh diyl 

Bow Ml? iiwtei of pUnnini tlai in you lUotttd uch diyl 



J. ofuo do ttichiri in yjur dtptrtitDtt 
a. Help uch other develop teitif 
bi Shin cwrie ouCIIqii vlth uch otliirl 

c. Obienre each other'e cliiieiT 

d. Dliaii itudenti' leinlog problem 
vlt]} eich other? 



*. Pleiic Mcite the extent of your 
airecMnt or diiifreeKDi: vlth etch of 
the follftrlBt lUCCienUi 

I. 1 Mb! buty icidealc denodi on 
itudeoti. 

b, School bu I ipeclal reipou'h. Uty 
to itudtQCi vho ere fiilloi. 

c. There li too uch preiiure oo tuchen to 
t«Mi and etaUiitc itudenti' lumlng, 

If I didn't hite to iride itudenti, 
lw)uld rirely if enr|ln teiti» 

u I itrlcth (oforci voik deidlloei in 
■y couriH. 



Seldoi Occiilott- v«cy 
SlUSJI iiil Oflw Often 



Strongly 



Conenti 



f\m i»m AU uaiiRiw; qumioNS in terhs or mis coursii 

U Bow unj yun hive yoo been ttiching thti couriet 

8. U tWi coane tmjht hf other leicheri ir your ichoolt ]fei_ Jio_ 
ir *TES.' AHSWEI QUESTIONS 9-10; IF 'NO/ SKIP It) (JUESTIOJI li. 

9. lio you end other teicben of thli courie; 

e. Oie the me teitr T<i_ No_ Don't know _ 

b. Die the iim coune outllnei end echedulei? rei_ le_ Doo't know 

Ct tiff the aiM teiti? Tci_^ No_ Doo't know _ 

10. Urn oftee do you talk to oth«r teichui Seldoi Occa- 

of thla courie ibout your: orHewr ilocally Ofttn 

ei Coune |oali? 
bi Covne tcitil 
Ci Cndlog itindardi? 

11. HoM l^»otUQt to you ii U that all a«tioni of thii coune leet tha 
IIM leamlni objectlvei? 

foe liportant Sotevhat luporunt Very liportant 

U. When you grade icudenci In thli coune Seldoi Occr 

at Che attd of the tent, often do you; or Kem ilonallj ofjca 

i* Crade according to a curve? 

b. Allw itudenci Co nlie their grade 

by co^jletlng ukeup aiilgnaenul 

c. Allow etudenti to nlae their gnde by 

doing optiooal ettra-credlt mlgDMOti ; _ 

d. Kequin itudeoti to bring t^elr wort 
up to a pniet itiodird before you 
iialgn a palling grade? 

e. Clve I itudcpt who ' > ichleved 
ii^ortaot lairalog UiH, ' ^ who hii 

ahcw a lot o/, projj .igber gride 

than iconi ou teit: .Lher voii 
itrlctly vould allv^ 



Very 
OftfH 



V«ry 

Often 



CoHttnta 
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5 'J 



f\m iXMi u mim mnm u of m too mSmslZr 



51 or About About Hore than 
leii 10-20r 2W3I 35t 



tbli cliii: 

•* Ii ftot xndf <or the Icni of vork? 

b. ti t(^o idviQctd for the leitl of vort? 

Did yott live i tut it ck k|lttmn< of the jm to «iieii itudeot 
reAdlncii for dill cliii? Tm no 

15» Wll |lv8 1 final ei» IB thli cliu? Yci Ho 

!! 'I^^ ^ ^ gride vlll COM froi the 

fleuliuat lOZor leii^ 1W0I_ 25-30Z_ Hore thin 30:_ 

16. lntlaicIiii,,b<«thwoft« 0Qcilo2veeki Ooce kntH 

Of jMi often lueek tlie .i i vttj 

t» Short qulttci! 

c« toclui Mrklhiitit ^ ^ 

17. Ifl tjii cli.1, hdi of tea do yoy gin wrltteo ii.lgnieDt. thit require 
imil diTi for tbi itude&t to cci^lete-^or ixuple, probln i<u, 
libcntoty rtporti, 11M71, itorlei, or bock reporti? 

Uii thttoo«i««tJi _ AboutoticimrT3«tiki 
Ab(wtpflcii«ontb _ CdceorioritYiryawtb 

W«t klDdi of nitten uilpKBti do you give! 



Evet7 



IB. k tiicbir My diddi to gift lepinte mbicoru 
to dlfferiQt pirti of lach vrltten iiilgneati- 
for exnple, icorti for different ireii of 
liinUoi luch II bovledii lod ikilli. 

Hoif of tin do you ^in lepinte icorei to pirti of 
•uch Krlttea.iiiliju.. a u tWi cliut 



Rirely 

if mr Sgtetltei Rejtulirl^ 



Vbit iiptcti of letm. , or work do you icore lepiritelyt 



W N(V AST tOU TO THIH ABOUT m m TESTS TOU GIVE IN WIS CUSS, 

All rcttlQlog iiuiitloM in ibout tei^u chit dul vUh lubtuntUl ncdoni of the 
cour.. content. Suck tut. in oft« .lid ^^lt te.t.; .cd that ten 1. .aed here, 



^9- Uotf often do you gWe unit teiu la thl« dan! 

Aboit QDce iviry vcek 
Aboit oQCi every tvo veeki 
Abwt once eviry three veeki 
About once every lonth 
Uii thin onci 1 lonth 

20' Vhit perccDUge of the itudent'i gride for thl! 
coftei froi unit teitif 

Uii tbiD 202 

About 20-251 
About 3W5Z 
About 3 
30Z or lori 

21> Hov of till do you ttii thl folloulng Mtbodi 
to lofon itudinU h tbli cUai iHout vhat 
they vlll bi ixpictid to know on 1 unit ceitt 

I. At the begianlof of 1 unit or period of 
loitructlOQi I infon itudeoti vhat tbey 
vlll bi expected to know on the teit 
for chit unit or period. 

b. taring I unit or period of Initnictlon, 
I gin itudioti ittplei of tbe klndi of 
queitloni to be Included on the leit for 
tbit unit or pirlod. 

c. A diy or 10 bifori 1 teit, I conduct 1 
fonul riTlcv of thi knowledge end 
ikllli to b« tilted. 



Kirily 

If ever Soaetlaea Re/t^larly 



Couenci 
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y« *::t towtructlm a uolt tut 
taki Biw iQ thli cUu, hw often do you 
"wticbof thi foJ.'Moi prictlceit 

1. 1 iMk idv:* iroi other teachert ilwut 
the queirk' jrw written, 

^ I ulecf or idiipt teit ItcM thit 
iecoipioy textbooki or other currloilui 
MterUlfi. 

C4 1 uii a written Hit of student leimlnn 
objfctlfti iM I lulde for deyeloplnK or 
iilecti!\| teit lte«, 

4« I loekdfi itc» thit deuod hlsher leveli 
oi thinking tbio cUiirooi taiki. 

«• I i^i Ititi that [iqulri 1^ judsieot 
to icon ct «iiluit<'.| ouch ai opcreoded 
tMij quaitiotii or proUeia that ban 
ion thao OM cornet aniwer. 

U I aiubilib aUodardi tor parforMut 
M a teat that atudeuci uat Mit before 
thay MTi OP to ncv toplci or unlta» 

1. 1 draiop altanuta (orM of tuta In 
on!» to ritut itudcnta who fall the 
flnt tlM around, 



CovKttta 



23» Vbeft yoy art icorlof unit tcata In thla 
clua, hff often do jou uia each of the 
foUoiik^ pracUcai? 

1 gin lore weight or pohti to lte« 
that cover Mtcrlal itreiaed in daii 
thin to Iteii that com laterlal I hive 
not Itreiaed. 

b» 1 calculate leparate icorei for different 
aectlooi of the teit that deil with dli- 
tlnct lunlog goali-for exaaple, know- 
ledge of facta VI. ippUcatloo of ikllli. 

c* I provldt written couinti on teit paperi 
to auppleient or elaborite on teit icorei. 

d. I dlacMnt particular ItcM on a teit th<c 
•tudenti ihw to be unfair or confining. 



Rirelir 

If ever Sowtlwi kejtulirly 



^irely 

l£mr hi\\hx \) U. 



When joQ loclode lte« oo unit teiti In thli 
cUii that riqutri your judgient to icore 
or evaLiate» boi often do you uie enjUdt 
i 'otlngrildelln*i» luch ii ritlns pcileit 

Whit iipccti of Iianlng do you icore leparitcly/ 



23. Vhen dlicuiilog reiulti of unit teiCi 
with thla dull how often do you: 

a. Inform tba daii about particular iim 
or lectloM of the tut on which i hrge 
nuiber of itudenta did poorly. 



iUrely 

ii em SoetlMi Rgj^ulirji 



b. Infon the dan ibout partlcUr ItcM 
or lectlOM of the tut on which a large 
n«ber of studenta did exceptionally vdh 

26. On hcv Hoy ucU tuta In thli dui hive: 



Pew or About Kearly 
none of half tb« etery 
the Ceiti teili tMt 



«« « large mber of itudenta done 
poorlyf 

b. a large ouber of i tudenti done 
exceptloully vellt 

2?. yhen a lagje percentage of thli dan do«i 
poorly OQ a unit teat, bow often do you 
uie the fdlowlng practices 



iUrely 

11 em SotMtlMi R?jt\jUrly 



>. After going over tut reiulti with the 
dau, I ipend one or lore dan perlcdi 
f'Mchlnt the laterlil. 

- ^ 20lng over teit reiulti with the 
ii, I Mve oa to the next topic or 
lU In order to keep to the courie 
ichedulci 

ci \ conmlt **hflr teicheri about ted 
content f itudent learning probltw. 



Conaenti 



CoanenU 
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28. vwq ic V- .dull itodint or imU 4r2i£ 
of It*- . 2 thli cUii doti on I 
«alt f. ofUft do ;ou uii th« 
folltt'ibi, rvACtloM? 

I iptclil correctlvi or rwdU 
littrtKUoo outalde the rtjulir cIibi 
period. 

I cr«4te ipecUI leimlng ictwitlii la 
cbii fee ittch itudeata In idditloo to 

e. I irrint for p««r tutorii 

d. I dml(^ Itii difdoilt lemlni objec- 
tlwi for ittch itudcati aud idipt 
■r CeicUax lud ^ tciti iccordloily. 

e* I tilk to pirtoti iboot itudcoCi' 

I tilk to oCbir tucben ibout atudcnti' 
leimlri problem. 

I* I refer itudioti Kor ipielil teitlni 

or help vith larcloi problcM. 

CoueQCi 



Rirely 

ilim Sowtlie> Rexulirly 



3U. Ap?roxl«t«l, vbt pircenliie of tbi pointi uilUbli 
on I unit ttft In thii clan conei froi teit it^ii 
with I ultlplrcbolc* or short-iniwer forMt? 

31. How 1.07 of tbe (juedtlon* oo your udU ttiti do you chinge fro. mi 
to yeir? ' 



Alsoit Done 



^««. Hoit VlrtuiUy lU^ 



In ordir :o uodtriUnd your «ppro4ch to teitlng ind iiitiioent o! itudent 
progreii Id cbli elm, wh«t ihould bow that h«u not been covcrtd 
by the Iten m thli <iuistIonnilrc? For exaicple, h«K your dipirtotnf 
developed id iiplldt progrii of teichlnj ind Uitlnn for thli cours*, 
or hive you idopted i pirtlculir itntegy ii i reiult of pait tr.ilrlng 
ind experience! V. you hive tl«, U'j would ipprecUt'* your ihnrlng yont 
Ideal with UB on thli page, 



When iQ IndiTiduil itudcot or lull iroup 
of itudenti Id thli clui doei ixccptlooilly 
SSU on I inlt tut, bov often do you ou 
tbe follwloi prictlcui 

«• 1 live rfpedil ttrlchlai or iccileritloi 
iMtructloo outilde tbi cltii period. 

b. 1 Ilk lucb Itudenti to lerve ii peer 
tutori. 

c. I creite ipicli?. Jumlni ictlfltiii 
iQ cllll for luch Itudenti In iddltlM 
to rcfulir vorlc. 

d. I letelop ton idnnred leirnlni objic^ 
tltei lot luch nu^CDt* lod idipt 

■7 teichlng ind tiiti iccordlnjly. 



brely 

ijf ever So ^tliei Rjj^ 



Coneoti 
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APPKNDIX B 

Measures of Students' Academic Work and Participation in Class 

The analysis of predictors of students' efforts to study is part of a 
larger research effort to build a model of predictors of students" academic 
effort and participation in schooling. Other analyses are underway using the 
present data base, and a concurrent study by Duckworth and deJung (1986) has 
identified influences on students'* rates of skipping school and cutting 
class. In this appendix, we describe student response to seven measures of 
effort and participation that were shown ^n Table Til- 2 of the main t;ext to 
be correlated wit^. he Effort index (composed of questionnaire items on 
studying for tests and working hard in class). Table 1 of this appendix 
show, che distribution of student responses to those seven questions. 

The first item (16) asked how many hours the student spent studying 
or doing hc^rjework for the class in which the ouestionnaire was administered. 
The da*-.. r'r.'%: that, except in geometry, n f-^vrth or more of the students in 
each subjecr reported spending one ..our at st a week. Never did a fourth 
of the students in a subject report studying more rhan t-.ree hours a week for 
the class. Biology students reported the least amount of timn spent. 

The second item (21) asked how often the student had homework done on 
time. Except in biology, half or more of the students in a subject responded 
"nearly always," Also except in biology, less than a fourth of the students 
in a subject reported only "occasionally" or "almost never," The first two 
items indicate that biology students in all reported expending less academic 
effort than students in the other three subjects. This was not inconsistent 
with the findings reported in Table II-l, which showed that biology and 
history students reported less often studying thoroughly before tests and 
that biology scudents reported less often working hard than English and 
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history students, although not than geometry students. 

The fhlrd item (24) asked about engagement In class rather than 
academic effort as such. In all, about a third of the students reported that 
their minds "nearly always" or "often" wandered during lessons in the class* 
Of all the si:udents, biology students were most likely to respond "nearly 
always. " 

The fourth Item (30) asked about participation in class pursuant to 
engagement. About a third of the stuu ^nts In all responded that they "nearly 
always" asked questions In class when they didn't understand. Biology 
students were least likely to respond "nearly always." 

The fifth item (23) asked about a form of participation in class that 
required extra effort— seeking, the teacher's help outside class time when a 
student didn't understand the material. Student-; were less likely to report 
taking this action "nearly always" than asking questions in class "nearly 
always," and more than a third of the students in each subject reported 
"almost never" seeking the teacher's help. 

Finally, the sixth and sc?vfeiV"^ items (14 and } 3) asked about 
avoidance of the class—temporary avoidance, in th ^ form of coming to class 
late, and major avoidance, in the form of cutting class. As the table shows, 
about two thirds of the students in all reported hardly ever being late to 
class, and nearly 90 percent of the students in all reported hardly ever 
cutting class. 



Reference: Duckwc rth, Kerneth, and deJung, John. "Variation in Student 
Skipping: A Study of Six Schools." Eugene, Oregon: Center 
for Educational Policy and Management, University of Oregon, 
1986. 
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Appendix B 
Table 1 

Students' Academic Work and Part:!cipation 
(Percentage of students, in each subject and in all, 
selecting questionnaire responses) 



Questionnaire Item 


Response 


Biol 


Geom 


Engl 


Hist 


All 


9. How many hours each 


> 5 hrs. 


5 


5 


5 


5 


5 


week do you spend outside 


A-5 hrs. 


1 1 


19 


17 


19 


; 7 


class studying or doing 


2-3 hrs. 


46 


57 


51 


50 


51 


homework for this class * 


1 hr, at most 


8 


20 


27 


26 


27 


21. I have my homework 


N'2arly always 


''■3 


54 


52 


50 


50 


done when I oome to class 


Of i:en 


31 


28 


28 


30 


29 




Or casionally 


19 


14 


15 


15 


16 




Almost never 


8 


4 


5 


5 


6 


24. My mind wanders 


Nearly always 


18 


12 


13 


1.5 


14 


during lessons 


Or ten 


15 


20 


17 


20 


18 


this class 


Occasionally 


47 


47 


49 


44 


47 




Almost never 


20 


22 


21 


21 


21 


30. I ask questions 


Nearly always 


26 


33 


36 


32 


32 


in clats when I don't 


C . ten 


26 


28 


24 


20 


25 


understand 


Occasionally 


32 


24 


26 


29 


28 




Almost never 


15 


16 


14 


19 


16 


23. ^ t ur.de r- 


Nearly always 


13 


15 


19 


10 


14 


6ta' ..-.-ial, I 


Of ter 


17 


16 


16 


14 


16 


S'iek acher's 


Occasionally 


34 


34 


30 


31 


32 


help ou lie class time 


Almost never 


36 


35 


36 


44 


38 


lA. How often are you More 


than once/wk 


8 


8 


7 


10 


8 


late to this class? * 


Once a week 


6 


6 


10 


13 


8 


Once every two weeks 


14 


14 


15 


18 


15 




Hardly ever 


71 


71 


68 


60 


68 


13. How often would Once a 


week or irore 


3 


3 


3 


2 




you say you have Once ^ 


every 2 weeks 


2 


4 


4 


6 


•4 


skipped cr cut 


Once a month 


4 


6 


5 


6 




this class? * 


Hardly ever 


92 


87 


89 


85 


38 



Number of students 391 A78 A20 405 1694 

* "Don't know" responses treated as missing responses. 

** Actual number for each item depends on number of missing responses. 
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